[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:56:35 dist-test-slave-lgr5 krb5kdc[19839](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:56:35 dist-test-slave-lgr5 krb5kdc[19839](info): set up 2 sockets
Aug 08 15:56:35 dist-test-slave-lgr5 krb5kdc[19839](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 15:56:37.001039 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.343s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:56:37 dist-test-slave-lgr5 krb5kdc[19839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:56:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:56:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:56:37.121752 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:40843
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:40843
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:37.230899 19855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:37.231139 19855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:37.231192 19855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:37.235080 19855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:56:37.235132 19855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:37.235158 19855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:37.235178 19855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:56:37.235199 19855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:56:37.240180 19855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:40843
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:40843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:37.241081 19855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:37.242000 19855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:37.250293 19863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:37.250322 19862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:37.250331 19855 server_base.cc:1034] running on GCE node
W20260808 15:56:37.250349 19866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:37.251081 19855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:37.252164 19855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:37.253336 19855 hybrid_clock.cc:648] HybridClock initialized: now 1786204597253315 us; error 85 us; skew 500 ppm
Aug 08 15:56:37 dist-test-slave-lgr5 krb5kdc[19839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204597, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:37.255926 19855 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:56:37.256808 19855 webserver.cc:460] Webserver started at http://127.19.93.62:44583/ using document root <none> and password file <none>
I20260808 15:56:37.257354 19855 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:37.257419 19855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:37.257612 19855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:37.259634 19855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "44bf66e9c922479391ac1c8f07083ce3"
format_stamp: "Formatted at 2026-08-08 15:56:37 on dist-test-slave-lgr5"
server_key: "dcd29603544a7dc4fbd9ec4eb7a85ba0"
server_key_iv: "83d299ffb77ebdf6ffb84e2a9e83f22d"
server_key_version: "encryptionkey@0"
I20260808 15:56:37.260207 19855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "44bf66e9c922479391ac1c8f07083ce3"
format_stamp: "Formatted at 2026-08-08 15:56:37 on dist-test-slave-lgr5"
server_key: "dcd29603544a7dc4fbd9ec4eb7a85ba0"
server_key_iv: "83d299ffb77ebdf6ffb84e2a9e83f22d"
server_key_version: "encryptionkey@0"
I20260808 15:56:37.263696 19855 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:56:37.265930 19876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:37.267026 19855 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:56:37.267138 19855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "44bf66e9c922479391ac1c8f07083ce3"
format_stamp: "Formatted at 2026-08-08 15:56:37 on dist-test-slave-lgr5"
server_key: "dcd29603544a7dc4fbd9ec4eb7a85ba0"
server_key_iv: "83d299ffb77ebdf6ffb84e2a9e83f22d"
server_key_version: "encryptionkey@0"
I20260808 15:56:37.267230 19855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:37.278601 19855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:37.281510 19855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:37.281687 19855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:37.288216 19855 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:40843
I20260808 15:56:37.288255 19963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:40843 every 8 connection(s)
I20260808 15:56:37.289093 19855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:56:37.291736 19966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:37.297055 19966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3: Bootstrap starting.
I20260808 15:56:37.298305 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 19855
I20260808 15:56:37.298445 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:56:37.299458 19966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:37.299724 19828 external_mini_cluster.cc:1428] Setting key f6f8bc297e6057eed1f3c6649d82718a
I20260808 15:56:37.300210 19966 log.cc:824] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3: Log is configured to *not* fsync() on all Append() calls
I20260808 15:56:37.302049 19966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3: No bootstrap required, opened a new log
I20260808 15:56:37.305922 19966 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44bf66e9c922479391ac1c8f07083ce3" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 40843 } }
I20260808 15:56:37.306134 19966 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:37.306192 19966 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44bf66e9c922479391ac1c8f07083ce3, State: Initialized, Role: FOLLOWER
I20260808 15:56:37.306630 19966 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44bf66e9c922479391ac1c8f07083ce3" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 40843 } }
I20260808 15:56:37.306790 19966 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:56:37.306859 19966 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:56:37.306949 19966 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:37.308046 19966 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44bf66e9c922479391ac1c8f07083ce3" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 40843 } }
I20260808 15:56:37.308457 19966 leader_election.cc:302] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44bf66e9c922479391ac1c8f07083ce3; no voters:
I20260808 15:56:37.308732 19966 leader_election.cc:288] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:56:37.308787 19976 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:37.308972 19976 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [term 1 LEADER]: Becoming Leader. State: Replica: 44bf66e9c922479391ac1c8f07083ce3, State: Running, Role: LEADER
I20260808 15:56:37.309252 19976 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44bf66e9c922479391ac1c8f07083ce3" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 40843 } }
I20260808 15:56:37.309929 19966 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:56:37.312151 19977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44bf66e9c922479391ac1c8f07083ce3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44bf66e9c922479391ac1c8f07083ce3" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 40843 } } }
I20260808 15:56:37.312631 19980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44bf66e9c922479391ac1c8f07083ce3. Latest consensus state: current_term: 1 leader_uuid: "44bf66e9c922479391ac1c8f07083ce3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44bf66e9c922479391ac1c8f07083ce3" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 40843 } } }
I20260808 15:56:37.313141 19977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [sys.catalog]: This master's current role is: LEADER
I20260808 15:56:37.313171 19980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3 [sys.catalog]: This master's current role is: LEADER
W20260808 15:56:37.314831 19995 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:56:37.314911 19995 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:56:37.314983 20002 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:56:37.315804 20002 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 15:56:37 dist-test-slave-lgr5 krb5kdc[19839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:37.321029 20002 catalog_manager.cc:1347] Generated new cluster ID: 6f3787a254b742fa9597b027d0447f4f
I20260808 15:56:37.321134 20002 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:56:37.323613 19971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:37.302625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55518 (local address 127.19.93.62:40843)
0808 15:56:37.303081 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:37.303100 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:37.304228 (+ 1128us) server_negotiation.cc:407] Connection header received
0808 15:56:37.306785 (+ 2557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:37.306803 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:37.307183 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:37.307520 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:37.309871 (+ 2351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:37.311278 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:37.312934 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:37.313661 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:37.313816 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:37.317744 (+ 3928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:37.317751 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:37.317767 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:37.317797 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:37.319883 (+ 2086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:37.320581 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:37.320586 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:37.320591 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:37.320725 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:37.321146 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:37.321150 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:37.321151 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:37.321642 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:37.321860 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:37.322463 (+ 603us) server_negotiation.cc:299] Negotiation successful
0808 15:56:37.322748 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":128,"threads_started":1}
I20260808 15:56:37.328699 20002 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:56:37.329452 20002 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:56:37.333923 20002 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44bf66e9c922479391ac1c8f07083ce3: Generated new TSK 0
I20260808 15:56:37.334452 20002 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 15:56:37.361307 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:40843
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:37.470456 20010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:37.470669 20010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:37.470714 20010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:37.474617 20010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:37.474668 20010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:37.474735 20010 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:56:37.479750 20010 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:40843
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:37.480717 20010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:37.481650 20010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:37.490662 20017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:37.490649 20018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:37.490824 20010 server_base.cc:1034] running on GCE node
W20260808 15:56:37.490649 20021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:37.491276 20010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:37.491885 20010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:37.493038 20010 hybrid_clock.cc:648] HybridClock initialized: now 1786204597493013 us; error 41 us; skew 500 ppm
Aug 08 15:56:37 dist-test-slave-lgr5 krb5kdc[19839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204597, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:37.495649 20010 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:56:37.496517 20010 webserver.cc:460] Webserver started at http://127.19.93.1:36935/ using document root <none> and password file <none>
I20260808 15:56:37.497045 20010 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:37.497112 20010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:37.497294 20010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:37.499254 20010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "148d165582fa420ca4fe3e80dd876e6d"
format_stamp: "Formatted at 2026-08-08 15:56:37 on dist-test-slave-lgr5"
server_key: "d61f26d5777d00072cd82390c5ee9864"
server_key_iv: "ff2361c843ddb74f07978f109bdd55b5"
server_key_version: "encryptionkey@0"
I20260808 15:56:37.499799 20010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "148d165582fa420ca4fe3e80dd876e6d"
format_stamp: "Formatted at 2026-08-08 15:56:37 on dist-test-slave-lgr5"
server_key: "d61f26d5777d00072cd82390c5ee9864"
server_key_iv: "ff2361c843ddb74f07978f109bdd55b5"
server_key_version: "encryptionkey@0"
I20260808 15:56:37.503310 20010 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260808 15:56:37.505544 20032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:37.506628 20010 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:56:37.506732 20010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "148d165582fa420ca4fe3e80dd876e6d"
format_stamp: "Formatted at 2026-08-08 15:56:37 on dist-test-slave-lgr5"
server_key: "d61f26d5777d00072cd82390c5ee9864"
server_key_iv: "ff2361c843ddb74f07978f109bdd55b5"
server_key_version: "encryptionkey@0"
I20260808 15:56:37.506826 20010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:37.519022 20010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:37.521965 20010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:37.522126 20010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:37.522656 20010 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:56:37.523418 20010 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:37.523468 20010 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:37.523520 20010 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:37.523550 20010 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:37.534231 20010 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:38219
I20260808 15:56:37.534291 20207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:38219 every 8 connection(s)
I20260808 15:56:37.535037 20010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:56:37.536984 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 20010
I20260808 15:56:37.537070 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:56:37.537295 19828 external_mini_cluster.cc:1428] Setting key fc350cff5d572a2d06f209baefc4b24e
Aug 08 15:56:37 dist-test-slave-lgr5 krb5kdc[19839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204597, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
I20260808 15:56:37.548013 19971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:37.536779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:44457 (local address 127.19.93.62:40843)
0808 15:56:37.536956 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:37.536962 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:37.538025 (+ 1063us) server_negotiation.cc:407] Connection header received
0808 15:56:37.538980 (+ 955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:37.538982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:37.539028 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:37.539092 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:37.540506 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:37.541013 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:37.542137 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:37.542372 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:37.542466 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:37.544741 (+ 2275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:37.544745 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:37.544748 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:37.544770 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:37.546077 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:37.546567 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:37.546570 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:37.546572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:37.546648 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:37.546972 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:37.546975 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:37.546977 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:37.547160 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:37.547246 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:37.547723 (+ 477us) server_negotiation.cc:299] Negotiation successful
0808 15:56:37.547851 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 15:56:37.548751 20211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:37.537162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:40843 (local address 127.19.93.1:44457)
0808 15:56:37.537860 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:37.537913 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:37.538775 (+ 862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:37.539289 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:37.539297 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:37.539732 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:37.540365 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:37.540384 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:37.541144 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:37.541147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:37.542005 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:37.542015 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:37.542523 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:37.542527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:37.542691 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:37.543188 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:37.543204 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:37.544581 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:37.546188 (+ 1607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:37.546194 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:37.546207 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:37.546459 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:37.546738 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:37.546741 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:37.546743 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:37.546869 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:37.547269 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:37.547275 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:37.547493 (+ 218us) client_negotiation.cc:769] Sending connection context
0808 15:56:37.547651 (+ 158us) client_negotiation.cc:240] Negotiation successful
0808 15:56:37.547998 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":125,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
I20260808 15:56:37.549916 20209 heartbeater.cc:347] Connected to a master server at 127.19.93.62:40843
I20260808 15:56:37.550140 20209 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:37.550595 20209 heartbeater.cc:511] Master 127.19.93.62:40843 requested a full tablet report, sending...
I20260808 15:56:37.552045 19904 ts_manager.cc:194] Registered new tserver with Master: 148d165582fa420ca4fe3e80dd876e6d (127.19.93.1:38219)
I20260808 15:56:37.553146 19904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:44457
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 15:56:37.564383 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:40843
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:37.672632 20214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:37.672852 20214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:37.672892 20214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:37.676770 20214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:37.676819 20214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:37.676877 20214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:56:37.681962 20214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:40843
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:37.682896 20214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:37.683840 20214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:56:37.693172 20214 server_base.cc:1034] running on GCE node
W20260808 15:56:37.693068 20219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:37.693096 20225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:37.693077 20223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:37.693691 20214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:37.694263 20214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:37.695425 20214 hybrid_clock.cc:648] HybridClock initialized: now 1786204597695394 us; error 43 us; skew 500 ppm
Aug 08 15:56:37 dist-test-slave-lgr5 krb5kdc[19839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204597, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:37.698094 20214 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:56:37.698906 20214 webserver.cc:460] Webserver started at http://127.19.93.2:43311/ using document root <none> and password file <none>
I20260808 15:56:37.699416 20214 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:37.699481 20214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:37.699668 20214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:37.701617 20214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "af092e6daaf5492681e3c5f12ab0fbba"
format_stamp: "Formatted at 2026-08-08 15:56:37 on dist-test-slave-lgr5"
server_key: "a5df9c660680fa59cda1272178f32f42"
server_key_iv: "80320eb04a5a3e37445cbb999a4ab0dc"
server_key_version: "encryptionkey@0"
I20260808 15:56:37.702155 20214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "af092e6daaf5492681e3c5f12ab0fbba"
format_stamp: "Formatted at 2026-08-08 15:56:37 on dist-test-slave-lgr5"
server_key: "a5df9c660680fa59cda1272178f32f42"
server_key_iv: "80320eb04a5a3e37445cbb999a4ab0dc"
server_key_version: "encryptionkey@0"
I20260808 15:56:37.705521 20214 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:56:37.707696 20235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:37.708806 20214 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:56:37.708909 20214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "af092e6daaf5492681e3c5f12ab0fbba"
format_stamp: "Formatted at 2026-08-08 15:56:37 on dist-test-slave-lgr5"
server_key: "a5df9c660680fa59cda1272178f32f42"
server_key_iv: "80320eb04a5a3e37445cbb999a4ab0dc"
server_key_version: "encryptionkey@0"
I20260808 15:56:37.709002 20214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:37.723825 20214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:37.726651 20214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:37.726812 20214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:37.727337 20214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:56:37.728124 20214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:37.728178 20214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:37.728228 20214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:37.728255 20214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:37.736694 20214 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:41163
I20260808 15:56:37.736723 20410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:41163 every 8 connection(s)
I20260808 15:56:37.737468 20214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:56:37.740202 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 20214
I20260808 15:56:37.740316 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:56:37.740577 19828 external_mini_cluster.cc:1428] Setting key 8ff5b64c2caad073e78b0d0b52d90568
Aug 08 15:56:37 dist-test-slave-lgr5 krb5kdc[19839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204597, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
I20260808 15:56:37.750819 19971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:37.739181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:45711 (local address 127.19.93.62:40843)
0808 15:56:37.739313 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:37.739317 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:37.740405 (+ 1088us) server_negotiation.cc:407] Connection header received
0808 15:56:37.741364 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:37.741368 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:37.741430 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:37.741511 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:37.742777 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:37.743353 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:37.744602 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:37.744826 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:37.744930 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:37.747274 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:37.747277 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:37.747279 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:37.747303 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:37.748756 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:37.749268 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:37.749272 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:37.749273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:37.749366 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:37.749721 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:37.749725 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:37.749726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:37.749923 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:37.750029 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:37.750513 (+ 484us) server_negotiation.cc:299] Negotiation successful
0808 15:56:37.750641 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 15:56:37.751534 20414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:37.739476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:40843 (local address 127.19.93.2:45711)
0808 15:56:37.740195 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:37.740237 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:37.741136 (+ 899us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:37.741688 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:37.741695 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:37.742154 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:37.742609 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:37.742624 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:37.743492 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:37.743496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:37.744464 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:37.744476 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:37.744975 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:37.744979 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:37.745149 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:37.745668 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:37.745684 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:37.747100 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:37.748883 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:37.748889 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:37.748902 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:37.749157 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:37.749472 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:37.749475 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:37.749477 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:37.749616 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:37.750040 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:37.750046 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:37.750272 (+ 226us) client_negotiation.cc:769] Sending connection context
0808 15:56:37.750444 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 15:56:37.750776 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":107,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
I20260808 15:56:37.752677 20411 heartbeater.cc:347] Connected to a master server at 127.19.93.62:40843
I20260808 15:56:37.752910 20411 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:37.753444 20411 heartbeater.cc:511] Master 127.19.93.62:40843 requested a full tablet report, sending...
I20260808 15:56:37.754534 19904 ts_manager.cc:194] Registered new tserver with Master: af092e6daaf5492681e3c5f12ab0fbba (127.19.93.2:41163)
I20260808 15:56:37.755103 19904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:45711
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 15:56:37.766809 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:40843
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:37.874253 20417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:37.874466 20417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:37.874506 20417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:37.878422 20417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:37.878473 20417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:37.878530 20417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:56:37.883507 20417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:40843
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:37.884431 20417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:37.885360 20417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:37.894414 20433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:37.894512 20417 server_base.cc:1034] running on GCE node
W20260808 15:56:37.894423 20429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:37.894415 20435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:37.895179 20417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:37.895794 20417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:37.896950 20417 hybrid_clock.cc:648] HybridClock initialized: now 1786204597896933 us; error 29 us; skew 500 ppm
Aug 08 15:56:37 dist-test-slave-lgr5 krb5kdc[19839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204597, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:37.899456 20417 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:56:37.900322 20417 webserver.cc:460] Webserver started at http://127.19.93.3:39297/ using document root <none> and password file <none>
I20260808 15:56:37.900849 20417 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:37.900914 20417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:37.901131 20417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:37.903017 20417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "e7d8dbd359354da58d98fec86d482e49"
format_stamp: "Formatted at 2026-08-08 15:56:37 on dist-test-slave-lgr5"
server_key: "b7fe2ab809b4ea9634d045f2c7550b07"
server_key_iv: "31b1413c76fed32805897d0e66877f3d"
server_key_version: "encryptionkey@0"
I20260808 15:56:37.903548 20417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "e7d8dbd359354da58d98fec86d482e49"
format_stamp: "Formatted at 2026-08-08 15:56:37 on dist-test-slave-lgr5"
server_key: "b7fe2ab809b4ea9634d045f2c7550b07"
server_key_iv: "31b1413c76fed32805897d0e66877f3d"
server_key_version: "encryptionkey@0"
I20260808 15:56:37.907004 20417 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 15:56:37.909467 20443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:37.910787 20417 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:56:37.910946 20417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "e7d8dbd359354da58d98fec86d482e49"
format_stamp: "Formatted at 2026-08-08 15:56:37 on dist-test-slave-lgr5"
server_key: "b7fe2ab809b4ea9634d045f2c7550b07"
server_key_iv: "31b1413c76fed32805897d0e66877f3d"
server_key_version: "encryptionkey@0"
I20260808 15:56:37.911054 20417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:37.924448 20417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:37.927233 20417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:37.927371 20417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:37.927858 20417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:56:37.928644 20417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:37.928689 20417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:37.928726 20417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:37.928745 20417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:37.937422 20417 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:42137
I20260808 15:56:37.937503 20610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:42137 every 8 connection(s)
I20260808 15:56:37.938261 20417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:56:37.942080 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 20417
I20260808 15:56:37.942201 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:56:37.942495 19828 external_mini_cluster.cc:1428] Setting key 9dd40092239ec0bc1efa6fd8ed7f212d
Aug 08 15:56:37 dist-test-slave-lgr5 krb5kdc[19839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204597, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:37.951275 19971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:37.939991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:59457 (local address 127.19.93.62:40843)
0808 15:56:37.940155 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:37.940160 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:37.941100 (+ 940us) server_negotiation.cc:407] Connection header received
0808 15:56:37.942073 (+ 973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:37.942076 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:37.942123 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:37.942210 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:37.943636 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:37.944346 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:37.945512 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:37.945741 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:37.945854 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:37.948165 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:37.948169 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:37.948171 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:37.948197 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:37.949376 (+ 1179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:37.949862 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:37.949865 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:37.949868 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:37.949951 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:37.950273 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:37.950277 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:37.950278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:37.950457 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:37.950543 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:37.951009 (+ 466us) server_negotiation.cc:299] Negotiation successful
0808 15:56:37.951120 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 15:56:37.951939 20613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:37.940311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:40843 (local address 127.19.93.3:59457)
0808 15:56:37.940940 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:37.940980 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:37.941819 (+ 839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:37.942423 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:37.942433 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:37.942917 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:37.943475 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:37.943497 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:37.944485 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:37.944489 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:37.945378 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:37.945389 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:37.945896 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:37.945901 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:37.946071 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:37.946547 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:37.946563 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:37.947974 (+ 1411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:37.949502 (+ 1528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:37.949508 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:37.949521 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:37.949756 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:37.950044 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:37.950047 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:37.950049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:37.950177 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:37.950568 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:37.950574 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:37.950783 (+ 209us) client_negotiation.cc:769] Sending connection context
0808 15:56:37.950938 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 15:56:37.951224 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":109,"threads_started":1}
I20260808 15:56:37.952922 20611 heartbeater.cc:347] Connected to a master server at 127.19.93.62:40843
I20260808 15:56:37.953114 20611 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:37.953516 20611 heartbeater.cc:511] Master 127.19.93.62:40843 requested a full tablet report, sending...
I20260808 15:56:37.954416 19904 ts_manager.cc:194] Registered new tserver with Master: e7d8dbd359354da58d98fec86d482e49 (127.19.93.3:42137)
I20260808 15:56:37.954950 19904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:59457
I20260808 15:56:37.956753 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 15:56:37 dist-test-slave-lgr5 krb5kdc[19839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204597, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 15:56:37 dist-test-slave-lgr5 krb5kdc[19839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204597, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.93.1@KRBTEST.COM
I20260808 15:56:37.989780 20620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:37.974954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49406 (local address 127.19.93.1:38219)
0808 15:56:37.975572 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:37.975588 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:37.976568 (+ 980us) server_negotiation.cc:407] Connection header received
0808 15:56:37.976645 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:37.976653 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:37.976918 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:37.977089 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:37.977949 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:37.979243 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:37.982371 (+ 3128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:37.982893 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:37.983004 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:37.986000 (+ 2996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:37.986009 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:37.986022 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:37.986058 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:37.987706 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:37.988228 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:37.988235 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:37.988237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:37.988337 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:37.988658 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:37.988661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:37.988663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:37.988984 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:37.989194 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:37.989426 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 15:56:37.989573 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":214,"threads_started":1}
W20260808 15:56:37.991094 20071 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49406
Aug 08 15:56:38 dist-test-slave-lgr5 krb5kdc[19839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 15:56:38 dist-test-slave-lgr5 krb5kdc[19839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.1@KRBTEST.COM
I20260808 15:56:38.019603 20620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:38.011430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49414 (local address 127.19.93.1:38219)
0808 15:56:38.011570 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:38.011575 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:38.011710 (+ 135us) server_negotiation.cc:407] Connection header received
0808 15:56:38.011894 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:38.011897 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:38.011957 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:38.012031 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:38.012716 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:38.013293 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:38.014091 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:38.014319 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:38.014444 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:38.016716 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:38.016719 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:38.016721 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:38.016745 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:38.018055 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:38.018467 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:38.018470 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:38.018471 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:38.018545 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:38.018805 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:38.018808 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:38.018810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:38.018970 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:38.019088 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:38.019328 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 15:56:38.019449 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 15:56:38.020548 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 20010
I20260808 15:56:38.030652 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 20214
I20260808 15:56:38.057591 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 20417
I20260808 15:56:38.070977 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 19855
2026-08-08T15:56:38Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2443 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:56:38 dist-test-slave-lgr5 krb5kdc[20628](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:56:38 dist-test-slave-lgr5 krb5kdc[20628](info): set up 2 sockets
Aug 08 15:56:38 dist-test-slave-lgr5 krb5kdc[20628](info): commencing operation
krb5kdc: starting...
W20260808 15:56:39.212968 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.004s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:56:39 dist-test-slave-lgr5 krb5kdc[20628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:56:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:56:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:56:39.332218 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:36501
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:44617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:36501
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:39.439841 20647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:39.440105 20647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:39.440161 20647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:39.443997 20647 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:56:39.444047 20647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:39.444072 20647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:39.444113 20647 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:56:39.444133 20647 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:56:39.449105 20647 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:44617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:36501
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:36501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:39.450022 20647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:39.450971 20647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:39.459046 20655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:39.459134 20659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:39.459100 20657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:39.459100 20647 server_base.cc:1034] running on GCE node
I20260808 15:56:39.459782 20647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:39.460816 20647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:39.461968 20647 hybrid_clock.cc:648] HybridClock initialized: now 1786204599461950 us; error 32 us; skew 500 ppm
Aug 08 15:56:39 dist-test-slave-lgr5 krb5kdc[20628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204599, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:39.464550 20647 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:56:39.465306 20647 webserver.cc:460] Webserver started at http://127.19.93.62:42107/ using document root <none> and password file <none>
I20260808 15:56:39.465803 20647 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:39.465864 20647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:39.466054 20647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:39.468375 20647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "67c735be222a4335b296f5026e5b8733"
format_stamp: "Formatted at 2026-08-08 15:56:39 on dist-test-slave-lgr5"
server_key: "621310bedb517e5ae67290fd9118eb41"
server_key_iv: "3548894dd9dd0b6ce4b6827493ef30f1"
server_key_version: "encryptionkey@0"
I20260808 15:56:39.469069 20647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "67c735be222a4335b296f5026e5b8733"
format_stamp: "Formatted at 2026-08-08 15:56:39 on dist-test-slave-lgr5"
server_key: "621310bedb517e5ae67290fd9118eb41"
server_key_iv: "3548894dd9dd0b6ce4b6827493ef30f1"
server_key_version: "encryptionkey@0"
I20260808 15:56:39.472792 20647 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:56:39.475032 20668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:39.476243 20647 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:56:39.476354 20647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "67c735be222a4335b296f5026e5b8733"
format_stamp: "Formatted at 2026-08-08 15:56:39 on dist-test-slave-lgr5"
server_key: "621310bedb517e5ae67290fd9118eb41"
server_key_iv: "3548894dd9dd0b6ce4b6827493ef30f1"
server_key_version: "encryptionkey@0"
I20260808 15:56:39.476447 20647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:39.500218 20647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:39.503125 20647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:39.503310 20647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:39.510146 20647 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:36501
I20260808 15:56:39.510164 20753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:36501 every 8 connection(s)
I20260808 15:56:39.511077 20647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:56:39.514026 20755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:39.518626 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 20647
I20260808 15:56:39.518731 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:56:39.518965 19828 external_mini_cluster.cc:1428] Setting key 48393a94f17b5470cc58bad7bb32c16b
I20260808 15:56:39.519411 20755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733: Bootstrap starting.
I20260808 15:56:39.521729 20755 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:39.522433 20755 log.cc:824] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733: Log is configured to *not* fsync() on all Append() calls
I20260808 15:56:39.524240 20755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733: No bootstrap required, opened a new log
Aug 08 15:56:39 dist-test-slave-lgr5 krb5kdc[20628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:39.527860 20755 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67c735be222a4335b296f5026e5b8733" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36501 } }
I20260808 15:56:39.528106 20755 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:39.528187 20755 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67c735be222a4335b296f5026e5b8733, State: Initialized, Role: FOLLOWER
I20260808 15:56:39.528661 20755 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67c735be222a4335b296f5026e5b8733" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36501 } }
I20260808 15:56:39.528823 20755 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:56:39.528896 20755 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:56:39.528998 20755 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:39.529783 20755 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67c735be222a4335b296f5026e5b8733" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36501 } }
I20260808 15:56:39.530118 20755 leader_election.cc:302] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67c735be222a4335b296f5026e5b8733; no voters:
I20260808 15:56:39.530525 20755 leader_election.cc:288] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:56:39.530606 20763 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:39.530846 20763 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [term 1 LEADER]: Becoming Leader. State: Replica: 67c735be222a4335b296f5026e5b8733, State: Running, Role: LEADER
I20260808 15:56:39.531200 20763 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67c735be222a4335b296f5026e5b8733" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36501 } }
I20260808 15:56:39.531744 20755 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:56:39.532431 20763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67c735be222a4335b296f5026e5b8733. Latest consensus state: current_term: 1 leader_uuid: "67c735be222a4335b296f5026e5b8733" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67c735be222a4335b296f5026e5b8733" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36501 } } }
I20260808 15:56:39.532631 20763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [sys.catalog]: This master's current role is: LEADER
I20260808 15:56:39.532671 20761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:39.520227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48588 (local address 127.19.93.62:36501)
0808 15:56:39.520709 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:39.520723 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:39.520758 (+ 35us) server_negotiation.cc:407] Connection header received
0808 15:56:39.521348 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:39.521365 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:39.521661 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:39.521967 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:39.522746 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:39.523695 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:39.524634 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:39.525103 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:39.525262 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:39.527805 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:39.527810 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:39.527822 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:39.527848 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:39.529587 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:39.529988 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:39.529993 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:39.529999 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:39.530139 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:39.530419 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:39.530423 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:39.530425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:39.530946 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:39.531132 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:39.531415 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 15:56:39.531702 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":108,"threads_started":1}
I20260808 15:56:39.532845 20766 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67c735be222a4335b296f5026e5b8733" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67c735be222a4335b296f5026e5b8733" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36501 } } }
I20260808 15:56:39.533048 20766 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733 [sys.catalog]: This master's current role is: LEADER
I20260808 15:56:39.533064 20775 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:56:39.538480 20775 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:56:39.543464 20775 catalog_manager.cc:1347] Generated new cluster ID: f6f78604c95d4ad8897bdce73331b76f
I20260808 15:56:39.543524 20775 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:56:39.552561 20775 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:56:39.553354 20775 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:56:39.564551 20775 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67c735be222a4335b296f5026e5b8733: Generated new TSK 0
I20260808 15:56:39.565086 20775 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 15:56:39.598342 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36501
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:44617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:39.715160 20792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:39.715376 20792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:39.715417 20792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:39.719506 20792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:39.719569 20792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:39.719624 20792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:56:39.724697 20792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:44617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36501
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:39.725546 20792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:39.726405 20792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:39.735437 20799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:39.735394 20800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:39.735484 20792 server_base.cc:1034] running on GCE node
W20260808 15:56:39.735410 20803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:39.736033 20792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:39.736624 20792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:39.737789 20792 hybrid_clock.cc:648] HybridClock initialized: now 1786204599737771 us; error 31 us; skew 500 ppm
Aug 08 15:56:39 dist-test-slave-lgr5 krb5kdc[20628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204599, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:39.740371 20792 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:56:39.741127 20792 webserver.cc:460] Webserver started at http://127.19.93.1:35071/ using document root <none> and password file <none>
I20260808 15:56:39.741617 20792 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:39.741680 20792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:39.741854 20792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:39.743757 20792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "6889b481eca543c3a485724877faab22"
format_stamp: "Formatted at 2026-08-08 15:56:39 on dist-test-slave-lgr5"
server_key: "68946dcfc2f4d7a3aebc5197e08e34e5"
server_key_iv: "9ab7be718679218125736e19afc55664"
server_key_version: "encryptionkey@0"
I20260808 15:56:39.744320 20792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "6889b481eca543c3a485724877faab22"
format_stamp: "Formatted at 2026-08-08 15:56:39 on dist-test-slave-lgr5"
server_key: "68946dcfc2f4d7a3aebc5197e08e34e5"
server_key_iv: "9ab7be718679218125736e19afc55664"
server_key_version: "encryptionkey@0"
I20260808 15:56:39.747632 20792 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260808 15:56:39.749802 20814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:39.750867 20792 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:56:39.750970 20792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "6889b481eca543c3a485724877faab22"
format_stamp: "Formatted at 2026-08-08 15:56:39 on dist-test-slave-lgr5"
server_key: "68946dcfc2f4d7a3aebc5197e08e34e5"
server_key_iv: "9ab7be718679218125736e19afc55664"
server_key_version: "encryptionkey@0"
I20260808 15:56:39.751070 20792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:39.769169 20792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:39.771771 20792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:39.771932 20792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:39.772482 20792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:56:39.773237 20792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:39.773283 20792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:39.773331 20792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:39.773360 20792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:39.781757 20792 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:40899
I20260808 15:56:39.781868 20994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:40899 every 8 connection(s)
I20260808 15:56:39.782581 20792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:56:39.784462 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 20792
I20260808 15:56:39.784560 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:56:39.784811 19828 external_mini_cluster.cc:1428] Setting key 42be47e5e8defd8984967bbdcaa41ecf
Aug 08 15:56:39 dist-test-slave-lgr5 krb5kdc[20628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204599, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
I20260808 15:56:39.796979 20761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:39.784242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:43181 (local address 127.19.93.62:36501)
0808 15:56:39.784418 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:39.784423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:39.785245 (+ 822us) server_negotiation.cc:407] Connection header received
0808 15:56:39.786843 (+ 1598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:39.786845 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:39.786888 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:39.786953 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:39.788441 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:39.789214 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:39.790714 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:39.790937 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:39.791015 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:39.793794 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:39.793798 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:39.793799 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:39.793824 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:39.795127 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:39.795664 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:39.795666 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:39.795667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:39.795739 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:39.796007 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:39.796009 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:39.796010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:39.796224 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:39.796314 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:39.796764 (+ 450us) server_negotiation.cc:299] Negotiation successful
0808 15:56:39.796858 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
I20260808 15:56:39.797880 20998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:39.784607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36501 (local address 127.19.93.1:43181)
0808 15:56:39.785090 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:39.785145 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:39.786609 (+ 1464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:39.787128 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:39.787136 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:39.787599 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:39.788261 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:39.788283 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:39.789373 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:39.789376 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:39.790584 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:39.790602 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:39.791099 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:39.791103 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:39.791297 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:39.791873 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:39.791892 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:39.793630 (+ 1738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:39.795260 (+ 1630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:39.795266 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:39.795280 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:39.795575 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:39.795812 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:39.795814 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:39.795815 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:39.795936 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:39.796317 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:39.796322 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:39.796569 (+ 247us) client_negotiation.cc:769] Sending connection context
0808 15:56:39.796715 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 15:56:39.796952 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":116,"threads_started":1}
I20260808 15:56:39.799018 20996 heartbeater.cc:347] Connected to a master server at 127.19.93.62:36501
I20260808 15:56:39.799247 20996 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:39.799703 20996 heartbeater.cc:511] Master 127.19.93.62:36501 requested a full tablet report, sending...
I20260808 15:56:39.801316 20697 ts_manager.cc:194] Registered new tserver with Master: 6889b481eca543c3a485724877faab22 (127.19.93.1:40899)
I20260808 15:56:39.802886 20697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:43181
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 15:56:39.813028 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36501
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:44617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:39.920653 21001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:39.920879 21001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:39.920919 21001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:39.924800 21001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:39.924854 21001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:39.924911 21001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:56:39.929829 21001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:44617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36501
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:39.930716 21001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:39.931644 21001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:56:39.940840 21001 server_base.cc:1034] running on GCE node
W20260808 15:56:39.940788 21009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:39.940810 21011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:39.940788 21015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:39.941442 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:39.941993 21001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:39.943151 21001 hybrid_clock.cc:648] HybridClock initialized: now 1786204599943129 us; error 36 us; skew 500 ppm
Aug 08 15:56:39 dist-test-slave-lgr5 krb5kdc[20628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204599, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:39.945744 21001 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:56:39.946537 21001 webserver.cc:460] Webserver started at http://127.19.93.2:36369/ using document root <none> and password file <none>
I20260808 15:56:39.947048 21001 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:39.947108 21001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:39.947302 21001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:39.949268 21001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "4cb562774bb54ba0a95891e3c8fa23b6"
format_stamp: "Formatted at 2026-08-08 15:56:39 on dist-test-slave-lgr5"
server_key: "23d4be42e4dc2777bf8eeb8223f6d83e"
server_key_iv: "6e12d82814c40ab3ba39567a755e2797"
server_key_version: "encryptionkey@0"
I20260808 15:56:39.949792 21001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "4cb562774bb54ba0a95891e3c8fa23b6"
format_stamp: "Formatted at 2026-08-08 15:56:39 on dist-test-slave-lgr5"
server_key: "23d4be42e4dc2777bf8eeb8223f6d83e"
server_key_iv: "6e12d82814c40ab3ba39567a755e2797"
server_key_version: "encryptionkey@0"
I20260808 15:56:39.953220 21001 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:56:39.955519 21022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:39.956672 21001 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:56:39.956781 21001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "4cb562774bb54ba0a95891e3c8fa23b6"
format_stamp: "Formatted at 2026-08-08 15:56:39 on dist-test-slave-lgr5"
server_key: "23d4be42e4dc2777bf8eeb8223f6d83e"
server_key_iv: "6e12d82814c40ab3ba39567a755e2797"
server_key_version: "encryptionkey@0"
I20260808 15:56:39.956871 21001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:39.971452 21001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:39.974480 21001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:39.974658 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:39.975267 21001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:56:39.976263 21001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:39.976325 21001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:39.976377 21001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:39.976406 21001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:39.985304 21001 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:39137
I20260808 15:56:39.985335 21205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:39137 every 8 connection(s)
I20260808 15:56:39.986166 21001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:56:39.988440 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 21001
I20260808 15:56:39.988543 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:56:39.988802 19828 external_mini_cluster.cc:1428] Setting key 09fe9468cef60d5d95a4c1a809dcf214
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
Aug 08 15:56:39 dist-test-slave-lgr5 krb5kdc[20628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204599, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:40.005716 20761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:39.987836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:50781 (local address 127.19.93.62:36501)
0808 15:56:39.987974 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:39.987978 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:39.988840 (+ 862us) server_negotiation.cc:407] Connection header received
0808 15:56:39.990487 (+ 1647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:39.990490 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:39.990554 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:39.990627 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:39.991784 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:39.992395 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:39.993555 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:39.993846 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:39.993950 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.002119 (+ 8169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:40.002123 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:40.002125 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:40.002153 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:40.003508 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:40.004049 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:40.004052 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:40.004053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:40.004167 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:40.004511 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:40.004515 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:40.004516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:40.004722 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:40.004826 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:40.005404 (+ 578us) server_negotiation.cc:299] Negotiation successful
0808 15:56:40.005537 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:56:40.006547 21209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:39.988198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36501 (local address 127.19.93.2:50781)
0808 15:56:39.988677 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:39.988728 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:39.990253 (+ 1525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:39.990817 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:39.990823 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:39.991171 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:39.991629 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:39.991642 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:39.992518 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:39.992522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:39.993396 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:39.993426 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:39.994007 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:39.994010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:39.994163 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:39.998297 (+ 4134us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:39.998313 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:40.001886 (+ 3573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:40.003651 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:40.003657 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:40.003676 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:40.003935 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:40.004262 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:40.004266 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:40.004268 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:40.004411 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:40.004835 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:40.004841 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:40.005150 (+ 309us) client_negotiation.cc:769] Sending connection context
0808 15:56:40.005336 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 15:56:40.005680 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":114,"threads_started":1}
I20260808 15:56:40.007861 21206 heartbeater.cc:347] Connected to a master server at 127.19.93.62:36501
I20260808 15:56:40.008136 21206 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:40.008639 21206 heartbeater.cc:511] Master 127.19.93.62:36501 requested a full tablet report, sending...
I20260808 15:56:40.009718 20697 ts_manager.cc:194] Registered new tserver with Master: 4cb562774bb54ba0a95891e3c8fa23b6 (127.19.93.2:39137)
I20260808 15:56:40.010288 20697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:50781
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 15:56:40.018246 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36501
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:44617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:40.127287 21214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:40.127564 21214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:40.127627 21214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:40.131688 21214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:40.131745 21214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:40.131824 21214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:56:40.137091 21214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:44617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36501
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:40.138056 21214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:40.139075 21214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:40.148288 21221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:40.148298 21227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:40.148275 21222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:40.148500 21214 server_base.cc:1034] running on GCE node
I20260808 15:56:40.148983 21214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:40.149550 21214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:40.150715 21214 hybrid_clock.cc:648] HybridClock initialized: now 1786204600150697 us; error 33 us; skew 500 ppm
Aug 08 15:56:40 dist-test-slave-lgr5 krb5kdc[20628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204600, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:40.153579 21214 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:56:40.154573 21214 webserver.cc:460] Webserver started at http://127.19.93.3:38253/ using document root <none> and password file <none>
I20260808 15:56:40.155185 21214 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:40.155248 21214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:40.155412 21214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:40.157380 21214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "9933c045b771490fbea03dcd78e45e11"
format_stamp: "Formatted at 2026-08-08 15:56:40 on dist-test-slave-lgr5"
server_key: "68007d7c9f30a52ce73b4a985375bbd3"
server_key_iv: "d8056cad9b53c754aa7b5cb152226a85"
server_key_version: "encryptionkey@0"
I20260808 15:56:40.157887 21214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "9933c045b771490fbea03dcd78e45e11"
format_stamp: "Formatted at 2026-08-08 15:56:40 on dist-test-slave-lgr5"
server_key: "68007d7c9f30a52ce73b4a985375bbd3"
server_key_iv: "d8056cad9b53c754aa7b5cb152226a85"
server_key_version: "encryptionkey@0"
I20260808 15:56:40.161345 21214 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:56:40.163568 21238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:40.164739 21214 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:56:40.164832 21214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "9933c045b771490fbea03dcd78e45e11"
format_stamp: "Formatted at 2026-08-08 15:56:40 on dist-test-slave-lgr5"
server_key: "68007d7c9f30a52ce73b4a985375bbd3"
server_key_iv: "d8056cad9b53c754aa7b5cb152226a85"
server_key_version: "encryptionkey@0"
I20260808 15:56:40.164909 21214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:40.181255 21214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:40.184309 21214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:40.184456 21214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:40.184985 21214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:56:40.185753 21214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:40.185799 21214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:40.185837 21214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:40.185855 21214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:40.194465 21214 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:41151
I20260808 15:56:40.194510 21425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:41151 every 8 connection(s)
I20260808 15:56:40.195360 21214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:56:40.204335 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 21214
I20260808 15:56:40.204437 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
Aug 08 15:56:40 dist-test-slave-lgr5 krb5kdc[20628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204600, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:40.204685 19828 external_mini_cluster.cc:1428] Setting key 422a5756b51a8f06cd1160b2795f91f9
I20260808 15:56:40.208415 20761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:40.197327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:55063 (local address 127.19.93.62:36501)
0808 15:56:40.197505 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:40.197508 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:40.198341 (+ 833us) server_negotiation.cc:407] Connection header received
0808 15:56:40.199608 (+ 1267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:40.199611 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:40.199658 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:40.199733 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:40.200907 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.201430 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.202511 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.202710 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.202776 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.205169 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:40.205174 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:40.205176 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:40.205200 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:40.206654 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:40.207147 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:40.207150 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:40.207151 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:40.207228 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:40.207489 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:40.207491 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:40.207493 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:40.207650 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:40.207724 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:40.208196 (+ 472us) server_negotiation.cc:299] Negotiation successful
0808 15:56:40.208298 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 15:56:40.209230 21431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:40.197705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36501 (local address 127.19.93.3:55063)
0808 15:56:40.198168 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:40.198210 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:40.199413 (+ 1203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:40.199900 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:40.199906 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:40.200299 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:40.200770 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:40.200783 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.201538 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.201541 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:40.202417 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:40.202427 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.202824 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.202827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:40.202976 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.203475 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:40.203491 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:40.204998 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:40.206767 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:40.206773 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:40.206786 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:40.207067 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:40.207297 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:40.207300 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:40.207301 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:40.207424 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:40.207725 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:40.207730 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:40.207958 (+ 228us) client_negotiation.cc:769] Sending connection context
0808 15:56:40.208168 (+ 210us) client_negotiation.cc:240] Negotiation successful
0808 15:56:40.208417 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":131,"threads_started":1}
I20260808 15:56:40.210266 21427 heartbeater.cc:347] Connected to a master server at 127.19.93.62:36501
I20260808 15:56:40.210479 21427 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:40.210927 21427 heartbeater.cc:511] Master 127.19.93.62:36501 requested a full tablet report, sending...
I20260808 15:56:40.211854 20697 ts_manager.cc:194] Registered new tserver with Master: 9933c045b771490fbea03dcd78e45e11 (127.19.93.3:41151)
I20260808 15:56:40.212424 20697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:55063
I20260808 15:56:40.218472 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:56:40.228390 20761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:40.221804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36438 (local address 127.19.93.62:36501)
0808 15:56:40.221929 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:40.221934 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:40.222221 (+ 287us) server_negotiation.cc:407] Connection header received
0808 15:56:40.222280 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:40.222282 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:40.222318 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:40.222378 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:40.223012 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.223513 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.224323 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.224563 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.224642 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.225748 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:40.225752 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:40.225753 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:40.225777 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:40.227056 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:40.227421 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:40.227423 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:40.227424 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:40.227491 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:40.227678 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:40.227680 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:40.227681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:40.227871 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:40.227969 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:40.228135 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 15:56:40.228221 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 15:56:40.232860 20697 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36438:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:56:40.235809 20697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:56:40.249882 21445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:40.243929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:39137 (local address 127.0.0.1:36232)
0808 15:56:40.244496 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:40.244547 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:40.244678 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:40.245261 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:40.245268 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:40.245297 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:40.245452 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:40.245462 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.247073 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.247076 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:40.248533 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:40.248545 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.249364 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.249368 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:40.249487 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.249528 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 15:56:40.249631 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 15:56:40.249745 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"mutex_wait_us":85,"thread_start_us":57,"threads_started":1}
I20260808 15:56:40.250102 21450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:40.244685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59430 (local address 127.19.93.3:41151)
0808 15:56:40.245244 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:40.245258 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:40.245546 (+ 288us) server_negotiation.cc:407] Connection header received
0808 15:56:40.245626 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:40.245631 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:40.245809 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:40.245959 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:40.246225 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.247295 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.248683 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.249495 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.249623 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.249776 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:40.249834 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 15:56:40.249934 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":145,"threads_started":1}
I20260808 15:56:40.250304 21448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:40.244144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36232 (local address 127.19.93.2:39137)
0808 15:56:40.244638 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:40.244650 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:40.244676 (+ 26us) server_negotiation.cc:407] Connection header received
0808 15:56:40.244854 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:40.244860 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:40.245064 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:40.245627 (+ 563us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:40.245796 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.246919 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.248677 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.249229 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.249327 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.249480 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:40.250064 (+ 584us) server_negotiation.cc:299] Negotiation successful
0808 15:56:40.250162 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":178,"threads_started":1}
I20260808 15:56:40.250372 21446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:40.244588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:40899 (local address 127.0.0.1:34934)
0808 15:56:40.245614 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:40.245627 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:40.245726 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:40.246135 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:40.246138 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:40.246156 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:40.246244 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:40.246250 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.247187 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.247191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:40.248493 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:40.248504 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.249937 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.249941 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:40.250046 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.250072 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 15:56:40.250153 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 15:56:40.250232 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":960,"mutex_wait_us":68,"thread_start_us":76,"threads_started":1}
I20260808 15:56:40.250530 21449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:40.244108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:41151 (local address 127.0.0.1:59430)
0808 15:56:40.245348 (+ 1240us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:40.245362 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:40.245451 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:40.245956 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:40.245959 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:40.245980 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:40.246070 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:40.246077 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.247441 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.247444 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:40.248589 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:40.248596 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.249628 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.249631 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:40.249715 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.249736 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 15:56:40.249791 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 15:56:40.249844 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1181,"thread_start_us":93,"threads_started":1}
I20260808 15:56:40.250836 21451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:40.244996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34934 (local address 127.19.93.1:40899)
0808 15:56:40.245467 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:40.245479 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:40.245723 (+ 244us) server_negotiation.cc:407] Connection header received
0808 15:56:40.245848 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:40.245853 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:40.246023 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:40.246152 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:40.246331 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.247048 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.248623 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.249628 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.249731 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.249870 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:40.250546 (+ 676us) server_negotiation.cc:299] Negotiation successful
0808 15:56:40.250658 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":105,"threads_started":1}
I20260808 15:56:40.253643 20892 tablet_service.cc:1467] Processing CreateTablet for tablet f31d68c6785242149c5586c70b126d0f (DEFAULT_TABLE table=test-table [id=e98e1b0c48ab474681e53d4492105948]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:40.253523 21319 tablet_service.cc:1467] Processing CreateTablet for tablet f31d68c6785242149c5586c70b126d0f (DEFAULT_TABLE table=test-table [id=e98e1b0c48ab474681e53d4492105948]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:40.254693 20892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f31d68c6785242149c5586c70b126d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:40.254693 21319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f31d68c6785242149c5586c70b126d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:40.255666 21107 tablet_service.cc:1467] Processing CreateTablet for tablet f31d68c6785242149c5586c70b126d0f (DEFAULT_TABLE table=test-table [id=e98e1b0c48ab474681e53d4492105948]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:40.256662 21107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f31d68c6785242149c5586c70b126d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:40.262214 21452 tablet_bootstrap.cc:492] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6: Bootstrap starting.
I20260808 15:56:40.262845 21453 tablet_bootstrap.cc:492] T f31d68c6785242149c5586c70b126d0f P 6889b481eca543c3a485724877faab22: Bootstrap starting.
I20260808 15:56:40.264464 21456 tablet_bootstrap.cc:492] T f31d68c6785242149c5586c70b126d0f P 9933c045b771490fbea03dcd78e45e11: Bootstrap starting.
I20260808 15:56:40.264736 21452 tablet_bootstrap.cc:654] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:40.264909 21453 tablet_bootstrap.cc:654] T f31d68c6785242149c5586c70b126d0f P 6889b481eca543c3a485724877faab22: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:40.265539 21452 log.cc:824] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6: Log is configured to *not* fsync() on all Append() calls
I20260808 15:56:40.266192 21453 log.cc:824] T f31d68c6785242149c5586c70b126d0f P 6889b481eca543c3a485724877faab22: Log is configured to *not* fsync() on all Append() calls
I20260808 15:56:40.266691 21456 tablet_bootstrap.cc:654] T f31d68c6785242149c5586c70b126d0f P 9933c045b771490fbea03dcd78e45e11: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:40.267441 21452 tablet_bootstrap.cc:492] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6: No bootstrap required, opened a new log
I20260808 15:56:40.267629 21452 ts_tablet_manager.cc:1397] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:56:40.267982 21456 log.cc:824] T f31d68c6785242149c5586c70b126d0f P 9933c045b771490fbea03dcd78e45e11: Log is configured to *not* fsync() on all Append() calls
I20260808 15:56:40.268344 21453 tablet_bootstrap.cc:492] T f31d68c6785242149c5586c70b126d0f P 6889b481eca543c3a485724877faab22: No bootstrap required, opened a new log
I20260808 15:56:40.268579 21453 ts_tablet_manager.cc:1397] T f31d68c6785242149c5586c70b126d0f P 6889b481eca543c3a485724877faab22: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 15:56:40.270251 21456 tablet_bootstrap.cc:492] T f31d68c6785242149c5586c70b126d0f P 9933c045b771490fbea03dcd78e45e11: No bootstrap required, opened a new log
I20260808 15:56:40.270460 21456 ts_tablet_manager.cc:1397] T f31d68c6785242149c5586c70b126d0f P 9933c045b771490fbea03dcd78e45e11: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:56:40.270875 21452 raft_consensus.cc:348] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb562774bb54ba0a95891e3c8fa23b6" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39137 } } peers { permanent_uuid: "9933c045b771490fbea03dcd78e45e11" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 41151 } } peers { permanent_uuid: "6889b481eca543c3a485724877faab22" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40899 } }
I20260808 15:56:40.271093 21452 raft_consensus.cc:374] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:40.271164 21452 raft_consensus.cc:729] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cb562774bb54ba0a95891e3c8fa23b6, State: Initialized, Role: FOLLOWER
I20260808 15:56:40.271580 21452 consensus_queue.cc:260] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb562774bb54ba0a95891e3c8fa23b6" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39137 } } peers { permanent_uuid: "9933c045b771490fbea03dcd78e45e11" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 41151 } } peers { permanent_uuid: "6889b481eca543c3a485724877faab22" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40899 } }
I20260808 15:56:40.272349 21453 raft_consensus.cc:348] T f31d68c6785242149c5586c70b126d0f P 6889b481eca543c3a485724877faab22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb562774bb54ba0a95891e3c8fa23b6" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39137 } } peers { permanent_uuid: "9933c045b771490fbea03dcd78e45e11" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 41151 } } peers { permanent_uuid: "6889b481eca543c3a485724877faab22" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40899 } }
I20260808 15:56:40.272578 21452 ts_tablet_manager.cc:1428] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 15:56:40.272673 21453 raft_consensus.cc:374] T f31d68c6785242149c5586c70b126d0f P 6889b481eca543c3a485724877faab22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:40.272786 21453 raft_consensus.cc:729] T f31d68c6785242149c5586c70b126d0f P 6889b481eca543c3a485724877faab22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6889b481eca543c3a485724877faab22, State: Initialized, Role: FOLLOWER
I20260808 15:56:40.272899 21206 heartbeater.cc:503] Master 127.19.93.62:36501 was elected leader, sending a full tablet report...
I20260808 15:56:40.273224 21453 consensus_queue.cc:260] T f31d68c6785242149c5586c70b126d0f P 6889b481eca543c3a485724877faab22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb562774bb54ba0a95891e3c8fa23b6" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39137 } } peers { permanent_uuid: "9933c045b771490fbea03dcd78e45e11" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 41151 } } peers { permanent_uuid: "6889b481eca543c3a485724877faab22" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40899 } }
I20260808 15:56:40.273970 20996 heartbeater.cc:503] Master 127.19.93.62:36501 was elected leader, sending a full tablet report...
I20260808 15:56:40.274201 21453 ts_tablet_manager.cc:1428] T f31d68c6785242149c5586c70b126d0f P 6889b481eca543c3a485724877faab22: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 15:56:40.274299 21456 raft_consensus.cc:348] T f31d68c6785242149c5586c70b126d0f P 9933c045b771490fbea03dcd78e45e11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb562774bb54ba0a95891e3c8fa23b6" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39137 } } peers { permanent_uuid: "9933c045b771490fbea03dcd78e45e11" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 41151 } } peers { permanent_uuid: "6889b481eca543c3a485724877faab22" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40899 } }
I20260808 15:56:40.274580 21456 raft_consensus.cc:374] T f31d68c6785242149c5586c70b126d0f P 9933c045b771490fbea03dcd78e45e11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:40.274683 21456 raft_consensus.cc:729] T f31d68c6785242149c5586c70b126d0f P 9933c045b771490fbea03dcd78e45e11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9933c045b771490fbea03dcd78e45e11, State: Initialized, Role: FOLLOWER
I20260808 15:56:40.275147 21456 consensus_queue.cc:260] T f31d68c6785242149c5586c70b126d0f P 9933c045b771490fbea03dcd78e45e11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb562774bb54ba0a95891e3c8fa23b6" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39137 } } peers { permanent_uuid: "9933c045b771490fbea03dcd78e45e11" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 41151 } } peers { permanent_uuid: "6889b481eca543c3a485724877faab22" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40899 } }
I20260808 15:56:40.275785 21427 heartbeater.cc:503] Master 127.19.93.62:36501 was elected leader, sending a full tablet report...
I20260808 15:56:40.276165 21456 ts_tablet_manager.cc:1428] T f31d68c6785242149c5586c70b126d0f P 9933c045b771490fbea03dcd78e45e11: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260808 15:56:40.283577 20997 tablet.cc:2369] T f31d68c6785242149c5586c70b126d0f P 6889b481eca543c3a485724877faab22: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:56:40.446352 21428 tablet.cc:2369] T f31d68c6785242149c5586c70b126d0f P 9933c045b771490fbea03dcd78e45e11: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:56:40.487300 21207 tablet.cc:2369] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:56:40.636567 21460 raft_consensus.cc:482] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:56:40.636793 21460 raft_consensus.cc:504] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb562774bb54ba0a95891e3c8fa23b6" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39137 } } peers { permanent_uuid: "9933c045b771490fbea03dcd78e45e11" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 41151 } } peers { permanent_uuid: "6889b481eca543c3a485724877faab22" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40899 } }
I20260808 15:56:40.638002 21460 leader_election.cc:288] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9933c045b771490fbea03dcd78e45e11 (127.19.93.3:41151), 6889b481eca543c3a485724877faab22 (127.19.93.1:40899)
I20260808 15:56:40.642095 21451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:40.638409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:60405 (local address 127.19.93.1:40899)
0808 15:56:40.638563 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:40.638567 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:40.638985 (+ 418us) server_negotiation.cc:407] Connection header received
0808 15:56:40.639098 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:40.639101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:40.639152 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:40.639228 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:40.639502 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.639970 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.641132 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.641507 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.641595 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.641660 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:40.641892 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 15:56:40.641965 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 15:56:40.642117 21450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:40.638452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:47381 (local address 127.19.93.3:41151)
0808 15:56:40.638598 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:40.638603 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:40.638832 (+ 229us) server_negotiation.cc:407] Connection header received
0808 15:56:40.638950 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:40.638953 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:40.639007 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:40.639083 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:40.639420 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.639940 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.641115 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.641512 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.641610 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.641671 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:40.641944 (+ 273us) server_negotiation.cc:299] Negotiation successful
0808 15:56:40.642016 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 15:56:40.642095 21466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:40.638293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:40899 (local address 127.19.93.2:60405)
0808 15:56:40.638834 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:40.638870 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:40.638996 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:40.639253 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:40.639255 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:40.639269 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:40.639390 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:40.639398 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.640103 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.640106 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:40.640993 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:40.641002 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.641632 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.641636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:40.641763 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.641795 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 15:56:40.641851 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 15:56:40.641921 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"mutex_wait_us":93,"thread_start_us":72,"threads_started":1}
I20260808 15:56:40.642113 21467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:40.638293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:41151 (local address 127.19.93.2:47381)
0808 15:56:40.638699 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:40.638736 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:40.638846 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:40.639119 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:40.639122 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:40.639138 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:40.639271 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:40.639278 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.640068 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.640071 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:40.640981 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:40.640991 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.641633 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.641636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:40.641806 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.641825 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 15:56:40.641900 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 15:56:40.641964 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"mutex_wait_us":129,"thread_start_us":112,"threads_started":1}
I20260808 15:56:40.642767 21350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f31d68c6785242149c5586c70b126d0f" candidate_uuid: "4cb562774bb54ba0a95891e3c8fa23b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9933c045b771490fbea03dcd78e45e11" is_pre_election: true
I20260808 15:56:40.642870 20919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f31d68c6785242149c5586c70b126d0f" candidate_uuid: "4cb562774bb54ba0a95891e3c8fa23b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6889b481eca543c3a485724877faab22" is_pre_election: true
I20260808 15:56:40.643074 21350 raft_consensus.cc:2454] T f31d68c6785242149c5586c70b126d0f P 9933c045b771490fbea03dcd78e45e11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cb562774bb54ba0a95891e3c8fa23b6 in term 0.
I20260808 15:56:40.643147 20919 raft_consensus.cc:2454] T f31d68c6785242149c5586c70b126d0f P 6889b481eca543c3a485724877faab22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cb562774bb54ba0a95891e3c8fa23b6 in term 0.
I20260808 15:56:40.643625 21027 leader_election.cc:302] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4cb562774bb54ba0a95891e3c8fa23b6, 6889b481eca543c3a485724877faab22, 9933c045b771490fbea03dcd78e45e11; no voters:
I20260808 15:56:40.643882 21460 raft_consensus.cc:2781] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:56:40.643970 21460 raft_consensus.cc:482] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:56:40.644013 21460 raft_consensus.cc:3037] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:40.645066 21460 raft_consensus.cc:504] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb562774bb54ba0a95891e3c8fa23b6" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39137 } } peers { permanent_uuid: "9933c045b771490fbea03dcd78e45e11" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 41151 } } peers { permanent_uuid: "6889b481eca543c3a485724877faab22" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40899 } }
I20260808 15:56:40.645380 21460 leader_election.cc:288] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [CANDIDATE]: Term 1 election: Requested vote from peers 9933c045b771490fbea03dcd78e45e11 (127.19.93.3:41151), 6889b481eca543c3a485724877faab22 (127.19.93.1:40899)
I20260808 15:56:40.645738 21350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f31d68c6785242149c5586c70b126d0f" candidate_uuid: "4cb562774bb54ba0a95891e3c8fa23b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9933c045b771490fbea03dcd78e45e11"
I20260808 15:56:40.645829 20919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f31d68c6785242149c5586c70b126d0f" candidate_uuid: "4cb562774bb54ba0a95891e3c8fa23b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6889b481eca543c3a485724877faab22"
I20260808 15:56:40.645869 21350 raft_consensus.cc:3037] T f31d68c6785242149c5586c70b126d0f P 9933c045b771490fbea03dcd78e45e11 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:40.645952 20919 raft_consensus.cc:3037] T f31d68c6785242149c5586c70b126d0f P 6889b481eca543c3a485724877faab22 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:40.647133 21350 raft_consensus.cc:2454] T f31d68c6785242149c5586c70b126d0f P 9933c045b771490fbea03dcd78e45e11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cb562774bb54ba0a95891e3c8fa23b6 in term 1.
I20260808 15:56:40.647133 20919 raft_consensus.cc:2454] T f31d68c6785242149c5586c70b126d0f P 6889b481eca543c3a485724877faab22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cb562774bb54ba0a95891e3c8fa23b6 in term 1.
I20260808 15:56:40.647440 21027 leader_election.cc:302] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4cb562774bb54ba0a95891e3c8fa23b6, 6889b481eca543c3a485724877faab22, 9933c045b771490fbea03dcd78e45e11; no voters:
I20260808 15:56:40.647609 21460 raft_consensus.cc:2781] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:40.647815 21460 raft_consensus.cc:686] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [term 1 LEADER]: Becoming Leader. State: Replica: 4cb562774bb54ba0a95891e3c8fa23b6, State: Running, Role: LEADER
I20260808 15:56:40.648200 21460 consensus_queue.cc:237] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb562774bb54ba0a95891e3c8fa23b6" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39137 } } peers { permanent_uuid: "9933c045b771490fbea03dcd78e45e11" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 41151 } } peers { permanent_uuid: "6889b481eca543c3a485724877faab22" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40899 } }
I20260808 15:56:40.651197 20697 catalog_manager.cc:5495] T f31d68c6785242149c5586c70b126d0f P 4cb562774bb54ba0a95891e3c8fa23b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cb562774bb54ba0a95891e3c8fa23b6 (127.19.93.2). New cstate: current_term: 1 leader_uuid: "4cb562774bb54ba0a95891e3c8fa23b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb562774bb54ba0a95891e3c8fa23b6" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9933c045b771490fbea03dcd78e45e11" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 41151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6889b481eca543c3a485724877faab22" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40899 } health_report { overall_health: UNKNOWN } } }
Aug 08 15:56:40 dist-test-slave-lgr5 krb5kdc[20628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.1@KRBTEST.COM
I20260808 15:56:40.700299 21451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:40.691825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34944 (local address 127.19.93.1:40899)
0808 15:56:40.691966 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:40.691971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:40.692165 (+ 194us) server_negotiation.cc:407] Connection header received
0808 15:56:40.692280 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:40.692283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:40.692330 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:40.692397 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:40.693102 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.693588 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.694418 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.694633 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.694721 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.697108 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:40.697119 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:40.697134 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:40.697157 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:40.698567 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:40.698977 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:40.698983 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:40.698984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:40.699080 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:40.699345 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:40.699348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:40.699350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:40.699610 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:40.699818 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:40.700013 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 15:56:40.700168 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 15:56:40 dist-test-slave-lgr5 krb5kdc[20628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204600, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 15:56:40 dist-test-slave-lgr5 krb5kdc[20628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204600, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.93.1@KRBTEST.COM
I20260808 15:56:40.726989 21451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:40.718711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34956 (local address 127.19.93.1:40899)
0808 15:56:40.718862 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:40.718866 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:40.718982 (+ 116us) server_negotiation.cc:407] Connection header received
0808 15:56:40.719094 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:40.719097 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:40.719134 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:40.719195 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:40.719891 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.720464 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.721321 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.721545 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.721634 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.724055 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:40.724058 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:40.724060 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:40.724104 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:40.725387 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:40.725787 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:40.725790 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:40.725791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:40.725873 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:40.726137 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:40.726140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:40.726142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:40.726297 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:40.726411 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:40.726719 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 15:56:40.726829 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 15:56:40 dist-test-slave-lgr5 krb5kdc[20628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 15:56:40 dist-test-slave-lgr5 krb5kdc[20628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.1@KRBTEST.COM
I20260808 15:56:40.751426 21451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:40.743848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34970 (local address 127.19.93.1:40899)
0808 15:56:40.743972 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:40.743976 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:40.744144 (+ 168us) server_negotiation.cc:407] Connection header received
0808 15:56:40.744233 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:40.744236 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:40.744273 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:40.744335 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:40.744923 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.745425 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.746287 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:40.746498 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:40.746574 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:40.748798 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:40.748800 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:40.748802 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:40.748824 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:40.749909 (+ 1085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:40.750321 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:40.750324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:40.750326 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:40.750394 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:40.750676 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:40.750680 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:40.750682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:40.750830 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:40.750941 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:40.751181 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 15:56:40.751283 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260808 15:56:40.752805 20860 tablet_service.cc:2908] Rejecting scan request for tablet f31d68c6785242149c5586c70b126d0f: Uninitialized: clean time has not yet been initialized
I20260808 15:56:40.754638 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 20792
I20260808 15:56:40.766220 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 21001
I20260808 15:56:40.775872 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 21214
I20260808 15:56:40.785972 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 20647
2026-08-08T15:56:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2722 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:56:40 dist-test-slave-lgr5 krb5kdc[21493](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:56:40 dist-test-slave-lgr5 krb5kdc[21493](info): set up 2 sockets
Aug 08 15:56:40 dist-test-slave-lgr5 krb5kdc[21493](info): commencing operation
krb5kdc: starting...
W20260808 15:56:41.933457 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:56:42 dist-test-slave-lgr5 krb5kdc[21493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:56:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:56:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:56:42.052858 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:42219
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:42219
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:42.160104 21511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:42.160333 21511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:42.160378 21511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:42.164248 21511 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:56:42.164294 21511 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 15:56:42.164309 21511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:42.164338 21511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:42.164376 21511 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:56:42.164400 21511 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:56:42.169510 21511 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:42219
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:42219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:42.170450 21511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:42.171412 21511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:42.179541 21523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:42.179672 21511 server_base.cc:1034] running on GCE node
W20260808 15:56:42.179505 21518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:42.179586 21517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:42.180435 21511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:42.181454 21511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:42.182623 21511 hybrid_clock.cc:648] HybridClock initialized: now 1786204602182601 us; error 34 us; skew 500 ppm
Aug 08 15:56:42 dist-test-slave-lgr5 krb5kdc[21493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:42.185298 21511 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:56:42.186169 21511 webserver.cc:460] Webserver started at http://127.19.93.62:39879/ using document root <none> and password file <none>
I20260808 15:56:42.186693 21511 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:42.186757 21511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:42.186954 21511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:42.188956 21511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "7d725b8c81904d55a9963d2e2ec8789a"
format_stamp: "Formatted at 2026-08-08 15:56:42 on dist-test-slave-lgr5"
server_key: "be8f30bd4d3bb967066daee52308e1c5"
server_key_iv: "6162f758d850a5cdb35f109572024fcf"
server_key_version: "encryptionkey@0"
I20260808 15:56:42.189489 21511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "7d725b8c81904d55a9963d2e2ec8789a"
format_stamp: "Formatted at 2026-08-08 15:56:42 on dist-test-slave-lgr5"
server_key: "be8f30bd4d3bb967066daee52308e1c5"
server_key_iv: "6162f758d850a5cdb35f109572024fcf"
server_key_version: "encryptionkey@0"
I20260808 15:56:42.192951 21511 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:56:42.195123 21535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:42.196282 21511 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:56:42.196391 21511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "7d725b8c81904d55a9963d2e2ec8789a"
format_stamp: "Formatted at 2026-08-08 15:56:42 on dist-test-slave-lgr5"
server_key: "be8f30bd4d3bb967066daee52308e1c5"
server_key_iv: "6162f758d850a5cdb35f109572024fcf"
server_key_version: "encryptionkey@0"
I20260808 15:56:42.196485 21511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:42.223054 21511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:42.226186 21511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:42.226372 21511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:42.234184 21511 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:42219
I20260808 15:56:42.234200 21634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:42219 every 8 connection(s)
I20260808 15:56:42.235141 21511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:56:42.237856 21636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:42.238379 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 21511
I20260808 15:56:42.238492 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:56:42.238744 19828 external_mini_cluster.cc:1428] Setting key 94a51a976711934d2c4784cf0922cbef
I20260808 15:56:42.243753 21636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a: Bootstrap starting.
I20260808 15:56:42.246305 21636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:42.247121 21636 log.cc:824] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a: Log is configured to *not* fsync() on all Append() calls
Aug 08 15:56:42 dist-test-slave-lgr5 krb5kdc[21493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:42.248875 21636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a: No bootstrap required, opened a new log
I20260808 15:56:42.251686 21636 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d725b8c81904d55a9963d2e2ec8789a" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42219 } }
I20260808 15:56:42.251999 21636 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:42.252090 21636 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d725b8c81904d55a9963d2e2ec8789a, State: Initialized, Role: FOLLOWER
I20260808 15:56:42.252481 21636 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d725b8c81904d55a9963d2e2ec8789a" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42219 } }
I20260808 15:56:42.252612 21636 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:56:42.252676 21636 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:56:42.252770 21636 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:42.253026 21640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.239998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46126 (local address 127.19.93.62:42219)
0808 15:56:42.240431 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:42.240446 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:42.240481 (+ 35us) server_negotiation.cc:407] Connection header received
0808 15:56:42.241103 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:42.241118 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:42.241426 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:42.241684 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:42.242569 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.243552 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.244716 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.245174 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.245304 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.247916 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:42.247921 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:42.247934 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:42.247962 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:42.250027 (+ 2065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:42.250477 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:42.250482 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:42.250486 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:42.250596 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:42.250872 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:42.250876 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:42.250878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:42.251239 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:42.251442 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:42.251739 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 15:56:42.252170 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":104,"threads_started":1}
I20260808 15:56:42.253623 21636 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d725b8c81904d55a9963d2e2ec8789a" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42219 } }
I20260808 15:56:42.253963 21636 leader_election.cc:302] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d725b8c81904d55a9963d2e2ec8789a; no voters:
I20260808 15:56:42.254283 21636 leader_election.cc:288] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:56:42.254357 21643 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:42.254624 21643 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [term 1 LEADER]: Becoming Leader. State: Replica: 7d725b8c81904d55a9963d2e2ec8789a, State: Running, Role: LEADER
I20260808 15:56:42.254982 21643 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d725b8c81904d55a9963d2e2ec8789a" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42219 } }
I20260808 15:56:42.255451 21636 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:56:42.256556 21645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d725b8c81904d55a9963d2e2ec8789a. Latest consensus state: current_term: 1 leader_uuid: "7d725b8c81904d55a9963d2e2ec8789a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d725b8c81904d55a9963d2e2ec8789a" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42219 } } }
I20260808 15:56:42.256660 21645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [sys.catalog]: This master's current role is: LEADER
I20260808 15:56:42.256971 21644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d725b8c81904d55a9963d2e2ec8789a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d725b8c81904d55a9963d2e2ec8789a" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42219 } } }
I20260808 15:56:42.257030 21657 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:56:42.257071 21644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a [sys.catalog]: This master's current role is: LEADER
I20260808 15:56:42.260063 21657 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:56:42.265522 21657 catalog_manager.cc:1347] Generated new cluster ID: 629fd1a0072b4f59a601471da6216a6e
I20260808 15:56:42.265618 21657 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:56:42.275851 21657 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:56:42.277050 21657 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:56:42.289500 21657 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a: Generated new TSK 0
I20260808 15:56:42.290115 21657 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 15:56:42.320770 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42219
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:42.430060 21677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:42.430318 21677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:42.430365 21677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:42.434244 21677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:42.434300 21677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:42.434346 21677 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:56:42.434388 21677 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:56:42.439421 21677 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.93.62:42219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:42.440397 21677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:42.441365 21677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:42.450897 21686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:42.450933 21684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:42.450956 21688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:42.451179 21677 server_base.cc:1034] running on GCE node
I20260808 15:56:42.451620 21677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:42.452248 21677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:42.453421 21677 hybrid_clock.cc:648] HybridClock initialized: now 1786204602453407 us; error 29 us; skew 500 ppm
Aug 08 15:56:42 dist-test-slave-lgr5 krb5kdc[21493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:42.456183 21677 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:56:42.457034 21677 webserver.cc:460] Webserver started at http://127.19.93.1:44963/ using document root <none> and password file <none>
I20260808 15:56:42.457563 21677 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:42.457628 21677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:42.457876 21677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:42.459785 21677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "1f84ff123eb74f99964816c18bc93e21"
format_stamp: "Formatted at 2026-08-08 15:56:42 on dist-test-slave-lgr5"
server_key: "35b1a88c78cfa628c9772b5103821af2"
server_key_iv: "8c3dae5319b69fb71a870363c14e60ce"
server_key_version: "encryptionkey@0"
I20260808 15:56:42.460332 21677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "1f84ff123eb74f99964816c18bc93e21"
format_stamp: "Formatted at 2026-08-08 15:56:42 on dist-test-slave-lgr5"
server_key: "35b1a88c78cfa628c9772b5103821af2"
server_key_iv: "8c3dae5319b69fb71a870363c14e60ce"
server_key_version: "encryptionkey@0"
I20260808 15:56:42.463619 21677 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:56:42.465842 21699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:42.466944 21677 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:56:42.467036 21677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "1f84ff123eb74f99964816c18bc93e21"
format_stamp: "Formatted at 2026-08-08 15:56:42 on dist-test-slave-lgr5"
server_key: "35b1a88c78cfa628c9772b5103821af2"
server_key_iv: "8c3dae5319b69fb71a870363c14e60ce"
server_key_version: "encryptionkey@0"
I20260808 15:56:42.467129 21677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:42.493758 21677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:42.496632 21677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:42.496803 21677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:42.498206 21677 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:42.498253 21677 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:42.498307 21677 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:42.498337 21677 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:56:42 dist-test-slave-lgr5 krb5kdc[21493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:42.508285 21677 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:33325
I20260808 15:56:42.508412 21900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:33325 every 8 connection(s)
I20260808 15:56:42.509125 21677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:56:42.510933 21640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.499010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:40153 (local address 127.19.93.62:42219)
0808 15:56:42.499151 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:42.499156 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:42.500158 (+ 1002us) server_negotiation.cc:407] Connection header received
0808 15:56:42.501321 (+ 1163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:42.501325 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:42.501394 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:42.501486 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:42.502824 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.503628 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.505026 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.505270 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.505360 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.507723 (+ 2363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:42.507726 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:42.507728 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:42.507753 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:42.509137 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:42.509642 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:42.509646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:42.509649 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:42.509741 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:42.510070 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:42.510073 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:42.510074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:42.510247 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:42.510323 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:42.510714 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 15:56:42.510810 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 15:56:42.511641 21716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.499548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42219 (local address 127.19.93.1:40153)
0808 15:56:42.500004 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:42.500046 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:42.501090 (+ 1044us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:42.501652 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:42.501660 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:42.502070 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:42.502652 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.502672 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.503770 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.503773 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.504905 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.504915 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.505426 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.505431 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.505599 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.506079 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:42.506095 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:42.507563 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:42.509254 (+ 1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:42.509260 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:42.509272 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:42.509523 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:42.509825 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:42.509828 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:42.509830 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:42.509976 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:42.510329 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:42.510333 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:42.510531 (+ 198us) client_negotiation.cc:769] Sending connection context
0808 15:56:42.510668 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 15:56:42.510894 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":135,"threads_started":1}
I20260808 15:56:42.512883 21901 heartbeater.cc:347] Connected to a master server at 127.19.93.62:42219
I20260808 15:56:42.513027 21901 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:42.513468 21901 heartbeater.cc:511] Master 127.19.93.62:42219 requested a full tablet report, sending...
I20260808 15:56:42.514834 21562 ts_manager.cc:194] Registered new tserver with Master: 1f84ff123eb74f99964816c18bc93e21 (127.19.93.1:33325)
I20260808 15:56:42.516235 21562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:40153
I20260808 15:56:42.516736 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 21677
I20260808 15:56:42.516861 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:56:42.517153 19828 external_mini_cluster.cc:1428] Setting key 1f9b82a652e58c02e35d017b29a830d8
I20260808 15:56:42.521730 21640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.514976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:38443 (local address 127.19.93.62:42219)
0808 15:56:42.515101 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:42.515105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:42.515222 (+ 117us) server_negotiation.cc:407] Connection header received
0808 15:56:42.515288 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:42.515290 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:42.515326 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:42.515407 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:42.515805 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.516512 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.517549 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.517821 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.517911 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.518938 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:42.518941 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:42.518943 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:42.518963 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:42.520253 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:42.520665 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:42.520669 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:42.520670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:42.520745 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:42.521007 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:42.521010 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:42.521012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:42.521170 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:42.521253 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:42.521505 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 15:56:42.521599 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 15:56:42.521737 21908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.514889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42219 (local address 127.19.93.1:38443)
0808 15:56:42.515138 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:42.515152 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:42.515231 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:42.515443 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:42.515445 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:42.515585 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:42.515686 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.515693 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.516660 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.516663 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.517448 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.517459 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.517921 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.517925 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.518013 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.518429 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:42.518443 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:42.518810 (+ 367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:42.520354 (+ 1544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:42.520358 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:42.520360 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:42.520570 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:42.520833 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:42.520835 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:42.520837 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:42.520922 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:42.521263 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:42.521266 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:42.521351 (+ 85us) client_negotiation.cc:769] Sending connection context
0808 15:56:42.521435 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 15:56:42.521556 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":83,"threads_started":1}
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 15:56:42.542274 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42219
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:42.651124 21913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:42.651348 21913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:42.651387 21913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:42.655282 21913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:42.655335 21913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:42.655371 21913 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:56:42.655407 21913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:56:42.660538 21913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.93.62:42219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:42.661443 21913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:42.662352 21913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:42.671470 21923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:42.671587 21913 server_base.cc:1034] running on GCE node
W20260808 15:56:42.671551 21921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:42.671548 21919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:42.672122 21913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:42.672708 21913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:42.673856 21913 hybrid_clock.cc:648] HybridClock initialized: now 1786204602673840 us; error 28 us; skew 500 ppm
Aug 08 15:56:42 dist-test-slave-lgr5 krb5kdc[21493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:42.676731 21913 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:56:42.677556 21913 webserver.cc:460] Webserver started at http://127.19.93.2:43779/ using document root <none> and password file <none>
I20260808 15:56:42.678057 21913 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:42.678121 21913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:42.678375 21913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:42.680464 21913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "44027b256c8447bbb6a9a711c0fd39fc"
format_stamp: "Formatted at 2026-08-08 15:56:42 on dist-test-slave-lgr5"
server_key: "40c69eaa07e8bbd7d1fe464876a1d4d5"
server_key_iv: "5699c905890f37c4cf41a73672a29437"
server_key_version: "encryptionkey@0"
I20260808 15:56:42.681007 21913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "44027b256c8447bbb6a9a711c0fd39fc"
format_stamp: "Formatted at 2026-08-08 15:56:42 on dist-test-slave-lgr5"
server_key: "40c69eaa07e8bbd7d1fe464876a1d4d5"
server_key_iv: "5699c905890f37c4cf41a73672a29437"
server_key_version: "encryptionkey@0"
I20260808 15:56:42.684458 21913 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:56:42.686650 21934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:42.687776 21913 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:56:42.687891 21913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "44027b256c8447bbb6a9a711c0fd39fc"
format_stamp: "Formatted at 2026-08-08 15:56:42 on dist-test-slave-lgr5"
server_key: "40c69eaa07e8bbd7d1fe464876a1d4d5"
server_key_iv: "5699c905890f37c4cf41a73672a29437"
server_key_version: "encryptionkey@0"
I20260808 15:56:42.687978 21913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:42.710920 21913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:42.713557 21913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:42.713711 21913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:42.715124 21913 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:42.715171 21913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:42.715222 21913 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:42.715251 21913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:56:42 dist-test-slave-lgr5 krb5kdc[21493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:42.725370 21913 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:44873
I20260808 15:56:42.725483 22123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:44873 every 8 connection(s)
I20260808 15:56:42.726305 21913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:56:42.728202 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 21913
I20260808 15:56:42.728297 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:56:42.728551 19828 external_mini_cluster.cc:1428] Setting key 6aecb4802dc291fdfbd46c625c8bfeff
I20260808 15:56:42.728675 21640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.715856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:55369 (local address 127.19.93.62:42219)
0808 15:56:42.715990 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:42.715994 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:42.717131 (+ 1137us) server_negotiation.cc:407] Connection header received
0808 15:56:42.718140 (+ 1009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:42.718144 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:42.718210 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:42.718274 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:42.719898 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.720717 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.721991 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.722321 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.722435 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.725079 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:42.725083 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:42.725085 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:42.725114 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:42.726657 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:42.727210 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:42.727214 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:42.727216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:42.727299 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:42.727629 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:42.727632 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:42.727634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:42.727809 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:42.727902 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:42.728400 (+ 498us) server_negotiation.cc:299] Negotiation successful
0808 15:56:42.728517 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 15:56:42.729483 21948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.716466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42219 (local address 127.19.93.2:55369)
0808 15:56:42.716967 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:42.717007 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:42.717873 (+ 866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:42.718683 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:42.718692 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:42.719118 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:42.719724 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.719745 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.720854 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.720858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.721864 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.721877 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.722493 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.722498 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.722693 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.723238 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:42.723255 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:42.724906 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:42.726788 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:42.726793 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:42.726805 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:42.727108 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:42.727392 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:42.727396 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:42.727398 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:42.727528 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:42.727925 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:42.727931 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:42.728182 (+ 251us) client_negotiation.cc:769] Sending connection context
0808 15:56:42.728363 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 15:56:42.728667 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":134,"threads_started":1}
I20260808 15:56:42.730693 22124 heartbeater.cc:347] Connected to a master server at 127.19.93.62:42219
I20260808 15:56:42.730821 22124 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:42.731329 22124 heartbeater.cc:511] Master 127.19.93.62:42219 requested a full tablet report, sending...
I20260808 15:56:42.732453 21560 ts_manager.cc:194] Registered new tserver with Master: 44027b256c8447bbb6a9a711c0fd39fc (127.19.93.2:44873)
I20260808 15:56:42.733171 21560 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:55369
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
I20260808 15:56:42.739168 21640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.732837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:41387 (local address 127.19.93.62:42219)
0808 15:56:42.732968 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:42.732971 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:42.733147 (+ 176us) server_negotiation.cc:407] Connection header received
0808 15:56:42.733233 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:42.733236 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:42.733277 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:42.733350 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:42.733743 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.734221 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.734995 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.735220 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.735303 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.736397 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:42.736400 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:42.736403 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:42.736425 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:42.737660 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:42.738047 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:42.738050 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:42.738052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:42.738123 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:42.738382 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:42.738385 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:42.738387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:42.738592 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:42.738674 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:42.738938 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 15:56:42.739036 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:56:42.739176 22135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.732766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42219 (local address 127.19.93.2:41387)
0808 15:56:42.733070 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:42.733081 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:42.733165 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:42.733356 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:42.733358 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:42.733542 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:42.733633 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.733639 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.734348 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.734351 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.734885 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.734893 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.735326 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.735329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.735414 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.735829 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:42.735851 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:42.736264 (+ 413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:42.737767 (+ 1503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:42.737770 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:42.737772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:42.737955 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:42.738211 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:42.738214 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:42.738216 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:42.738293 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:42.738691 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:42.738694 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:42.738776 (+ 82us) client_negotiation.cc:769] Sending connection context
0808 15:56:42.738866 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 15:56:42.738993 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":98,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 15:56:42.756606 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42219
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:42.864329 22138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:42.864552 22138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:42.864591 22138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:42.868515 22138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:42.868563 22138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:42.868598 22138 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:56:42.868628 22138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:56:42.873623 22138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.93.62:42219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:42.874449 22138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:42.875339 22138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:56:42.884298 22138 server_base.cc:1034] running on GCE node
W20260808 15:56:42.884323 22149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:42.884435 22148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:42.884336 22152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:42.884886 22138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:42.885514 22138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:42.886695 22138 hybrid_clock.cc:648] HybridClock initialized: now 1786204602886680 us; error 25 us; skew 500 ppm
Aug 08 15:56:42 dist-test-slave-lgr5 krb5kdc[21493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:42.889366 22138 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:56:42.890185 22138 webserver.cc:460] Webserver started at http://127.19.93.3:42057/ using document root <none> and password file <none>
I20260808 15:56:42.890697 22138 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:42.890759 22138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:42.890942 22138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:42.892959 22138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "e817c75f0f9f4081890ea08dafabf7f5"
format_stamp: "Formatted at 2026-08-08 15:56:42 on dist-test-slave-lgr5"
server_key: "2919dc8f383f4e5e603c9a6a69751936"
server_key_iv: "5f0ea862e0796aa85efebd1df9a972d4"
server_key_version: "encryptionkey@0"
I20260808 15:56:42.893502 22138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "e817c75f0f9f4081890ea08dafabf7f5"
format_stamp: "Formatted at 2026-08-08 15:56:42 on dist-test-slave-lgr5"
server_key: "2919dc8f383f4e5e603c9a6a69751936"
server_key_iv: "5f0ea862e0796aa85efebd1df9a972d4"
server_key_version: "encryptionkey@0"
I20260808 15:56:42.896932 22138 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:56:42.899109 22167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:42.900288 22138 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260808 15:56:42.900396 22138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "e817c75f0f9f4081890ea08dafabf7f5"
format_stamp: "Formatted at 2026-08-08 15:56:42 on dist-test-slave-lgr5"
server_key: "2919dc8f383f4e5e603c9a6a69751936"
server_key_iv: "5f0ea862e0796aa85efebd1df9a972d4"
server_key_version: "encryptionkey@0"
I20260808 15:56:42.900485 22138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:42.917737 22138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:42.920559 22138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:42.920718 22138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:42.922029 22138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:42.922077 22138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:42.922127 22138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:42.922156 22138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:56:42 dist-test-slave-lgr5 krb5kdc[21493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:42.931874 22138 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:37537
I20260808 15:56:42.931898 22348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:37537 every 8 connection(s)
I20260808 15:56:42.932893 22138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:56:42.935139 21640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.922753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:51485 (local address 127.19.93.62:42219)
0808 15:56:42.922869 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:42.922873 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:42.923806 (+ 933us) server_negotiation.cc:407] Connection header received
0808 15:56:42.924811 (+ 1005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:42.924815 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:42.924876 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:42.924939 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:42.926600 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.927406 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.928733 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.929069 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.929187 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.931800 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:42.931804 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:42.931807 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:42.931838 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:42.933359 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:42.933928 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:42.933931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:42.933932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:42.934015 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:42.934287 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:42.934289 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:42.934290 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:42.934450 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:42.934520 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:42.934909 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 15:56:42.935007 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 15:56:42.935884 22182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.923213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42219 (local address 127.19.93.3:51485)
0808 15:56:42.923665 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:42.923704 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:42.924567 (+ 863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:42.925325 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:42.925333 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:42.925763 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:42.926356 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.926385 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.927513 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.927516 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.928611 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.928621 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.929225 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.929228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.929360 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.929843 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:42.929858 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:42.931640 (+ 1782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:42.933463 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:42.933469 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:42.933482 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:42.933801 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:42.934093 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:42.934095 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:42.934096 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:42.934219 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:42.934527 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:42.934531 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:42.934726 (+ 195us) client_negotiation.cc:769] Sending connection context
0808 15:56:42.934863 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 15:56:42.935116 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":131,"threads_started":1}
I20260808 15:56:42.937016 22350 heartbeater.cc:347] Connected to a master server at 127.19.93.62:42219
I20260808 15:56:42.937150 22350 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:42.937705 22350 heartbeater.cc:511] Master 127.19.93.62:42219 requested a full tablet report, sending...
I20260808 15:56:42.938715 21562 ts_manager.cc:194] Registered new tserver with Master: e817c75f0f9f4081890ea08dafabf7f5 (127.19.93.3:37537)
I20260808 15:56:42.939381 21562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:51485
I20260808 15:56:42.942421 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 22138
I20260808 15:56:42.942534 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:56:42.942826 19828 external_mini_cluster.cc:1428] Setting key 0333f6a5121564744a16b040435f331c
I20260808 15:56:42.945108 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:56:42.945359 22360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.939055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42219 (local address 127.19.93.3:47539)
0808 15:56:42.939291 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:42.939302 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:42.939396 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:42.939726 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:42.939728 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:42.939902 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:42.940011 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.940019 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.940741 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.940744 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.941418 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.941428 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.941775 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.941777 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.941837 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.942193 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:42.942203 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:42.942498 (+ 295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:42.943980 (+ 1482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:42.943982 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:42.943984 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:42.944222 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:42.944481 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:42.944484 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:42.944485 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:42.944578 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:42.944901 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:42.944904 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:42.944993 (+ 89us) client_negotiation.cc:769] Sending connection context
0808 15:56:42.945095 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 15:56:42.945208 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":89,"threads_started":1}
I20260808 15:56:42.945399 21640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.939103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:47539 (local address 127.19.93.62:42219)
0808 15:56:42.939207 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:42.939211 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:42.939365 (+ 154us) server_negotiation.cc:407] Connection header received
0808 15:56:42.939466 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:42.939469 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:42.939510 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:42.939576 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:42.940152 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.940612 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.941508 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.941699 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.941763 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.942621 (+ 858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:42.942625 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:42.942628 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:42.942653 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:42.943883 (+ 1230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:42.944305 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:42.944308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:42.944310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:42.944393 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:42.944660 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:42.944662 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:42.944664 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:42.944804 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:42.944889 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:42.945173 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 15:56:42.945273 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 15:56:42 dist-test-slave-lgr5 krb5kdc[21493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204602, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 15:56:42 dist-test-slave-lgr5 krb5kdc[21493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204602, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:42.970471 21640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.962916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46136 (local address 127.19.93.62:42219)
0808 15:56:42.963036 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:42.963040 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:42.963052 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:56:42.963089 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:42.963091 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:42.963127 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:42.963190 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:42.963796 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.964359 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.965139 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.965375 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.965450 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.967643 (+ 2193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:42.967647 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:42.967649 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:42.967674 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:42.969114 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:42.969450 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:42.969452 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:42.969454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:42.969531 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:42.969734 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:42.969736 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:42.969737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:42.969914 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:42.970016 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:42.970195 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 15:56:42.970334 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:56:42.973266 21562 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46136:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:56:42.976279 21562 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:56:42.989866 22382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.984219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:37537 (local address 127.0.0.1:52494)
0808 15:56:42.984551 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:42.984604 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:42.984730 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:42.985421 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:42.985427 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:42.985452 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:42.985578 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.985585 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.987013 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.987016 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.988320 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.988331 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.989338 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.989342 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.989447 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.989486 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 15:56:42.989598 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 15:56:42.989715 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":77,"thread_start_us":90,"threads_started":1}
I20260808 15:56:42.990010 22384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.984963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:33325 (local address 127.0.0.1:36102)
0808 15:56:42.985230 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:42.985243 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:42.985322 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:42.985977 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:42.985980 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:42.985999 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:42.986093 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.986099 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.987417 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.987421 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.988613 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.988624 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.989643 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.989646 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.989729 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.989749 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 15:56:42.989829 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 15:56:42.989885 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":1,"thread_start_us":105,"threads_started":1}
I20260808 15:56:42.990274 22387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.985312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:44873 (local address 127.0.0.1:60638)
0808 15:56:42.985522 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:42.985535 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:42.985626 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:42.986447 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:42.986449 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:42.986467 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:42.986567 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.986574 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.987771 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.987774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.988896 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:42.988906 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.989933 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.989937 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:42.990026 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.990047 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 15:56:42.990090 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 15:56:42.990150 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":97,"threads_started":1}
I20260808 15:56:42.990322 22385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.985148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36102 (local address 127.19.93.1:33325)
0808 15:56:42.985535 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:42.985551 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:42.985573 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:56:42.985645 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:42.985649 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:42.985827 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:42.986242 (+ 415us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:42.986365 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.987312 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.988748 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.989511 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.989621 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.989771 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:42.989868 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 15:56:42.990196 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":89,"threads_started":1}
I20260808 15:56:42.990459 22383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.984382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52494 (local address 127.19.93.3:37537)
0808 15:56:42.984751 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:42.984763 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:42.984789 (+ 26us) server_negotiation.cc:407] Connection header received
0808 15:56:42.984866 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:42.984872 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:42.985086 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:42.985238 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:42.985707 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.986873 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.988444 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.989223 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.989319 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.989493 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:42.990217 (+ 724us) server_negotiation.cc:299] Negotiation successful
0808 15:56:42.990317 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":158,"threads_started":1}
I20260808 15:56:42.991024 22388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:42.985743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60638 (local address 127.19.93.2:44873)
0808 15:56:42.986028 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:42.986039 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:42.986061 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:56:42.986131 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:42.986135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:42.986319 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:42.986469 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:42.986662 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.987641 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.989025 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:42.989801 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:42.990619 (+ 818us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:42.990770 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:42.990816 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 15:56:42.990894 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":91,"threads_started":1}
I20260808 15:56:42.993141 21781 tablet_service.cc:1467] Processing CreateTablet for tablet 2156918280be48e2bac100480d56a3fd (DEFAULT_TABLE table=test-table [id=67280918f79941c58aceb3c79d1eb10a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:42.993173 22248 tablet_service.cc:1467] Processing CreateTablet for tablet 2156918280be48e2bac100480d56a3fd (DEFAULT_TABLE table=test-table [id=67280918f79941c58aceb3c79d1eb10a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:42.993496 22019 tablet_service.cc:1467] Processing CreateTablet for tablet 2156918280be48e2bac100480d56a3fd (DEFAULT_TABLE table=test-table [id=67280918f79941c58aceb3c79d1eb10a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:42.994095 21781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2156918280be48e2bac100480d56a3fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:42.994217 22248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2156918280be48e2bac100480d56a3fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:42.994349 22019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2156918280be48e2bac100480d56a3fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:43.001137 22389 tablet_bootstrap.cc:492] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21: Bootstrap starting.
I20260808 15:56:43.001991 22391 tablet_bootstrap.cc:492] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5: Bootstrap starting.
I20260808 15:56:43.003479 22389 tablet_bootstrap.cc:654] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:43.004098 22391 tablet_bootstrap.cc:654] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:43.004386 22390 tablet_bootstrap.cc:492] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc: Bootstrap starting.
I20260808 15:56:43.004405 22389 log.cc:824] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21: Log is configured to *not* fsync() on all Append() calls
I20260808 15:56:43.004892 22391 log.cc:824] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5: Log is configured to *not* fsync() on all Append() calls
I20260808 15:56:43.006335 22390 tablet_bootstrap.cc:654] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:43.006579 22389 tablet_bootstrap.cc:492] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21: No bootstrap required, opened a new log
I20260808 15:56:43.006768 22389 ts_tablet_manager.cc:1397] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:56:43.006861 22391 tablet_bootstrap.cc:492] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5: No bootstrap required, opened a new log
I20260808 15:56:43.007046 22391 ts_tablet_manager.cc:1397] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 15:56:43.007193 22390 log.cc:824] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc: Log is configured to *not* fsync() on all Append() calls
I20260808 15:56:43.009142 22390 tablet_bootstrap.cc:492] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc: No bootstrap required, opened a new log
I20260808 15:56:43.009310 22390 ts_tablet_manager.cc:1397] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 15:56:43.009936 22389 raft_consensus.cc:348] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } }
I20260808 15:56:43.010188 22389 raft_consensus.cc:374] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:43.010247 22389 raft_consensus.cc:729] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f84ff123eb74f99964816c18bc93e21, State: Initialized, Role: FOLLOWER
I20260808 15:56:43.010671 22389 consensus_queue.cc:260] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } }
I20260808 15:56:43.010682 22391 raft_consensus.cc:348] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } }
I20260808 15:56:43.010962 22391 raft_consensus.cc:374] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:43.011073 22391 raft_consensus.cc:729] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e817c75f0f9f4081890ea08dafabf7f5, State: Initialized, Role: FOLLOWER
I20260808 15:56:43.011291 21901 heartbeater.cc:503] Master 127.19.93.62:42219 was elected leader, sending a full tablet report...
I20260808 15:56:43.011560 22389 ts_tablet_manager.cc:1428] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260808 15:56:43.011559 22391 consensus_queue.cc:260] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } }
I20260808 15:56:43.012295 22350 heartbeater.cc:503] Master 127.19.93.62:42219 was elected leader, sending a full tablet report...
I20260808 15:56:43.012691 22391 ts_tablet_manager.cc:1428] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 15:56:43.013463 22390 raft_consensus.cc:348] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } }
I20260808 15:56:43.013660 22390 raft_consensus.cc:374] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:43.013736 22390 raft_consensus.cc:729] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44027b256c8447bbb6a9a711c0fd39fc, State: Initialized, Role: FOLLOWER
I20260808 15:56:43.014081 22390 consensus_queue.cc:260] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } }
I20260808 15:56:43.014689 22124 heartbeater.cc:503] Master 127.19.93.62:42219 was elected leader, sending a full tablet report...
I20260808 15:56:43.014847 22390 ts_tablet_manager.cc:1428] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
W20260808 15:56:43.184051 22351 tablet.cc:2369] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:56:43.227444 22127 tablet.cc:2369] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:56:43.242882 22402 raft_consensus.cc:482] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:56:43.243084 22402 raft_consensus.cc:504] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } }
I20260808 15:56:43.244305 22402 leader_election.cc:288] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e817c75f0f9f4081890ea08dafabf7f5 (127.19.93.3:37537), 1f84ff123eb74f99964816c18bc93e21 (127.19.93.1:33325)
I20260808 15:56:43.248482 22385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.245008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:53959 (local address 127.19.93.1:33325)
0808 15:56:43.245138 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:43.245142 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:43.245301 (+ 159us) server_negotiation.cc:407] Connection header received
0808 15:56:43.245415 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:43.245418 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:43.245463 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:43.245528 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:43.245888 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.246393 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.247531 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.247925 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.248021 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.248116 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:43.248313 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 15:56:43.248385 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 15:56:43.248493 22406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.244866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:33325 (local address 127.19.93.2:53959)
0808 15:56:43.245206 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:43.245220 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:43.245320 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:43.245648 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:43.245651 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:43.245669 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:43.245771 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.245777 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.246512 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.246515 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.247394 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.247404 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.248061 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.248064 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.248182 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.248208 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 15:56:43.248276 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 15:56:43.248346 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":36,"thread_start_us":62,"threads_started":1}
I20260808 15:56:43.248571 22383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.245169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:36137 (local address 127.19.93.3:37537)
0808 15:56:43.245293 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:43.245297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:43.245310 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:56:43.245364 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:43.245367 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:43.245448 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:43.245528 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:43.245831 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.246352 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.247524 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.247944 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.248043 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.248126 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:43.248384 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 15:56:43.248455 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 15:56:43.248718 22404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.244522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:37537 (local address 127.19.93.2:36137)
0808 15:56:43.244741 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:43.244757 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:43.244857 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:43.245561 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:43.245564 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:43.245581 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:43.245711 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.245717 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.246480 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.246483 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.247392 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.247402 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.248183 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.248186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.248262 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.248279 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 15:56:43.248343 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 15:56:43.248425 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":68,"thread_start_us":63,"threads_started":1}
I20260808 15:56:43.249081 21816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2156918280be48e2bac100480d56a3fd" candidate_uuid: "44027b256c8447bbb6a9a711c0fd39fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f84ff123eb74f99964816c18bc93e21" is_pre_election: true
I20260808 15:56:43.249260 22273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2156918280be48e2bac100480d56a3fd" candidate_uuid: "44027b256c8447bbb6a9a711c0fd39fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e817c75f0f9f4081890ea08dafabf7f5" is_pre_election: true
I20260808 15:56:43.249348 21816 raft_consensus.cc:2454] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44027b256c8447bbb6a9a711c0fd39fc in term 0.
I20260808 15:56:43.249519 22273 raft_consensus.cc:2454] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44027b256c8447bbb6a9a711c0fd39fc in term 0.
I20260808 15:56:43.249809 21937 leader_election.cc:302] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f84ff123eb74f99964816c18bc93e21, 44027b256c8447bbb6a9a711c0fd39fc; no voters:
I20260808 15:56:43.250054 22402 raft_consensus.cc:2781] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:56:43.250129 22402 raft_consensus.cc:482] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:56:43.250159 22402 raft_consensus.cc:3037] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:43.251168 22402 raft_consensus.cc:504] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } }
I20260808 15:56:43.251477 22402 leader_election.cc:288] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [CANDIDATE]: Term 1 election: Requested vote from peers e817c75f0f9f4081890ea08dafabf7f5 (127.19.93.3:37537), 1f84ff123eb74f99964816c18bc93e21 (127.19.93.1:33325)
I20260808 15:56:43.251854 22273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2156918280be48e2bac100480d56a3fd" candidate_uuid: "44027b256c8447bbb6a9a711c0fd39fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e817c75f0f9f4081890ea08dafabf7f5"
I20260808 15:56:43.251857 21816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2156918280be48e2bac100480d56a3fd" candidate_uuid: "44027b256c8447bbb6a9a711c0fd39fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f84ff123eb74f99964816c18bc93e21"
I20260808 15:56:43.251981 22273 raft_consensus.cc:3037] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:43.251981 21816 raft_consensus.cc:3037] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:43.253265 21816 raft_consensus.cc:2454] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44027b256c8447bbb6a9a711c0fd39fc in term 1.
I20260808 15:56:43.253597 21937 leader_election.cc:302] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f84ff123eb74f99964816c18bc93e21, 44027b256c8447bbb6a9a711c0fd39fc; no voters:
I20260808 15:56:43.253770 22402 raft_consensus.cc:2781] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:43.253772 22273 raft_consensus.cc:2454] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44027b256c8447bbb6a9a711c0fd39fc in term 1.
I20260808 15:56:43.253929 22402 raft_consensus.cc:686] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [term 1 LEADER]: Becoming Leader. State: Replica: 44027b256c8447bbb6a9a711c0fd39fc, State: Running, Role: LEADER
I20260808 15:56:43.254447 22402 consensus_queue.cc:237] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } }
I20260808 15:56:43.257515 21558 catalog_manager.cc:5495] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 44027b256c8447bbb6a9a711c0fd39fc (127.19.93.2). New cstate: current_term: 1 leader_uuid: "44027b256c8447bbb6a9a711c0fd39fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } health_report { overall_health: HEALTHY } } }
W20260808 15:56:43.260360 21902 tablet.cc:2369] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:56:43.286891 22388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.283209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60646 (local address 127.19.93.2:44873)
0808 15:56:43.283350 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:43.283355 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:43.283370 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:56:43.283620 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:43.283622 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:43.283680 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:43.283762 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:56:43.284041 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.284577 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.285452 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.285664 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.285751 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.286091 (+ 340us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:56:43.286477 (+ 386us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:56:43.286575 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:43.286695 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 15:56:43.286752 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 15:56:43.292445 21816 raft_consensus.cc:1261] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21 [term 1 FOLLOWER]: Refusing update from remote peer 44027b256c8447bbb6a9a711c0fd39fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:56:43.292445 22273 raft_consensus.cc:1261] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5 [term 1 FOLLOWER]: Refusing update from remote peer 44027b256c8447bbb6a9a711c0fd39fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:56:43.293103 22402 consensus_queue.cc:1035] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:56:43.293289 22409 consensus_queue.cc:1035] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:56:43.300452 22427 mvcc.cc:205] Tried to move back new op lower bound from 7316294055078879232 to 7316294054932508672. Current Snapshot: MvccSnapshot[applied={T|T < 7316294055078879232}]
I20260808 15:56:43.301431 22429 mvcc.cc:205] Tried to move back new op lower bound from 7316294055078879232 to 7316294054932508672. Current Snapshot: MvccSnapshot[applied={T|T < 7316294055078879232}]
I20260808 15:56:43.303349 22425 mvcc.cc:205] Tried to move back new op lower bound from 7316294055078879232 to 7316294054932508672. Current Snapshot: MvccSnapshot[applied={T|T < 7316294055078879232 or (T in {7316294055078879232})}]
I20260808 15:56:43.310879 21562 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:56:43.311058 21562 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:56:43.313553 21562 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a: Sending DeleteTablet for 3 replicas of tablet 2156918280be48e2bac100480d56a3fd
I20260808 15:56:43.314241 22248 tablet_service.cc:1514] Processing DeleteTablet for tablet 2156918280be48e2bac100480d56a3fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:43 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:52494
I20260808 15:56:43.314342 21781 tablet_service.cc:1514] Processing DeleteTablet for tablet 2156918280be48e2bac100480d56a3fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:43 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:36102
I20260808 15:56:43.314467 22019 tablet_service.cc:1514] Processing DeleteTablet for tablet 2156918280be48e2bac100480d56a3fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:43 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:60638
I20260808 15:56:43.314800 22444 tablet_replica.cc:330] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21: stopping tablet replica
I20260808 15:56:43.314899 22442 tablet_replica.cc:330] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5: stopping tablet replica
I20260808 15:56:43.315131 21562 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46136:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 15:56:43.315236 22442 raft_consensus.cc:2229] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260808 15:56:43.315487 21562 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:56:43.315526 22442 raft_consensus.cc:2258] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:43.316157 22444 raft_consensus.cc:2229] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:56:43.316437 22444 raft_consensus.cc:2258] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:43.316767 22446 tablet_replica.cc:330] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc: stopping tablet replica
I20260808 15:56:43.317071 22446 raft_consensus.cc:2229] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:56:43.317433 22446 raft_consensus.cc:2258] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:43.317442 22442 ts_tablet_manager.cc:1905] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:43.317844 22444 ts_tablet_manager.cc:1905] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:43.320226 22442 ts_tablet_manager.cc:1918] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:56:43.320315 22442 log.cc:1196] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/2156918280be48e2bac100480d56a3fd
I20260808 15:56:43.320502 22444 ts_tablet_manager.cc:1918] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:56:43.320597 22444 log.cc:1196] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/wal/wals/2156918280be48e2bac100480d56a3fd
I20260808 15:56:43.320647 22442 ts_tablet_manager.cc:1939] T 2156918280be48e2bac100480d56a3fd P e817c75f0f9f4081890ea08dafabf7f5: Deleting consensus metadata
I20260808 15:56:43.320866 22444 ts_tablet_manager.cc:1939] T 2156918280be48e2bac100480d56a3fd P 1f84ff123eb74f99964816c18bc93e21: Deleting consensus metadata
I20260808 15:56:43.321658 21781 tablet_service.cc:1467] Processing CreateTablet for tablet 289681fe6e7c4d97bcedd08c7c4a1da8 (DEFAULT_TABLE table=test-table [id=ae0d50a6ed4e473ead4c01695940c860]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:43.321913 21781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 289681fe6e7c4d97bcedd08c7c4a1da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:43.321923 21537 catalog_manager.cc:4841] TS 1f84ff123eb74f99964816c18bc93e21 (127.19.93.1:33325): tablet 2156918280be48e2bac100480d56a3fd (table test-table [id=67280918f79941c58aceb3c79d1eb10a]) successfully deleted
I20260808 15:56:43.322187 22248 tablet_service.cc:1467] Processing CreateTablet for tablet 289681fe6e7c4d97bcedd08c7c4a1da8 (DEFAULT_TABLE table=test-table [id=ae0d50a6ed4e473ead4c01695940c860]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:43.322417 22248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 289681fe6e7c4d97bcedd08c7c4a1da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:43.323694 22389 tablet_bootstrap.cc:492] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21: Bootstrap starting.
I20260808 15:56:43.323979 21537 catalog_manager.cc:4841] TS e817c75f0f9f4081890ea08dafabf7f5 (127.19.93.3:37537): tablet 2156918280be48e2bac100480d56a3fd (table test-table [id=67280918f79941c58aceb3c79d1eb10a]) successfully deleted
I20260808 15:56:43.324486 22391 tablet_bootstrap.cc:492] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5: Bootstrap starting.
I20260808 15:56:43.324610 22389 tablet_bootstrap.cc:654] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:43.324664 22019 tablet_service.cc:1467] Processing CreateTablet for tablet 289681fe6e7c4d97bcedd08c7c4a1da8 (DEFAULT_TABLE table=test-table [id=ae0d50a6ed4e473ead4c01695940c860]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:43.324911 22019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 289681fe6e7c4d97bcedd08c7c4a1da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:43.325407 22391 tablet_bootstrap.cc:654] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:43.326450 22391 tablet_bootstrap.cc:492] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5: No bootstrap required, opened a new log
I20260808 15:56:43.326507 22391 ts_tablet_manager.cc:1397] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 15:56:43.326828 22391 raft_consensus.cc:348] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.326908 22391 raft_consensus.cc:374] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:43.326928 22391 raft_consensus.cc:729] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e817c75f0f9f4081890ea08dafabf7f5, State: Initialized, Role: FOLLOWER
I20260808 15:56:43.327031 22391 consensus_queue.cc:260] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.327198 22390 tablet_bootstrap.cc:492] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc: Bootstrap starting.
I20260808 15:56:43.327287 22391 ts_tablet_manager.cc:1428] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 15:56:43.328007 22389 tablet_bootstrap.cc:492] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21: No bootstrap required, opened a new log
I20260808 15:56:43.328105 22389 ts_tablet_manager.cc:1397] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 15:56:43.328114 22390 tablet_bootstrap.cc:654] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:43.328547 22389 raft_consensus.cc:348] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.328642 22389 raft_consensus.cc:374] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:43.328673 22389 raft_consensus.cc:729] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f84ff123eb74f99964816c18bc93e21, State: Initialized, Role: FOLLOWER
I20260808 15:56:43.328789 22389 consensus_queue.cc:260] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.329049 22389 ts_tablet_manager.cc:1428] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:56:43.330307 22390 tablet_bootstrap.cc:492] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc: No bootstrap required, opened a new log
I20260808 15:56:43.330389 22390 ts_tablet_manager.cc:1397] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 15:56:43.330758 22390 raft_consensus.cc:348] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.330870 22390 raft_consensus.cc:374] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:43.330901 22390 raft_consensus.cc:729] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44027b256c8447bbb6a9a711c0fd39fc, State: Initialized, Role: FOLLOWER
I20260808 15:56:43.331010 22390 consensus_queue.cc:260] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.331252 22390 ts_tablet_manager.cc:1428] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:56:43.333297 22446 ts_tablet_manager.cc:1905] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:43.335810 22446 ts_tablet_manager.cc:1918] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:56:43.335904 22446 log.cc:1196] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/2156918280be48e2bac100480d56a3fd
I20260808 15:56:43.336216 22446 ts_tablet_manager.cc:1939] T 2156918280be48e2bac100480d56a3fd P 44027b256c8447bbb6a9a711c0fd39fc: Deleting consensus metadata
I20260808 15:56:43.337392 21537 catalog_manager.cc:4841] TS 44027b256c8447bbb6a9a711c0fd39fc (127.19.93.2:44873): tablet 2156918280be48e2bac100480d56a3fd (table test-table [id=67280918f79941c58aceb3c79d1eb10a]) successfully deleted
I20260808 15:56:43.387368 22439 raft_consensus.cc:482] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:56:43.387516 22439 raft_consensus.cc:504] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.387928 22439 leader_election.cc:288] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f84ff123eb74f99964816c18bc93e21 (127.19.93.1:33325), e817c75f0f9f4081890ea08dafabf7f5 (127.19.93.3:37537)
I20260808 15:56:43.388360 21816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "289681fe6e7c4d97bcedd08c7c4a1da8" candidate_uuid: "44027b256c8447bbb6a9a711c0fd39fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f84ff123eb74f99964816c18bc93e21" is_pre_election: true
I20260808 15:56:43.388466 22273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "289681fe6e7c4d97bcedd08c7c4a1da8" candidate_uuid: "44027b256c8447bbb6a9a711c0fd39fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e817c75f0f9f4081890ea08dafabf7f5" is_pre_election: true
I20260808 15:56:43.388530 21816 raft_consensus.cc:2454] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44027b256c8447bbb6a9a711c0fd39fc in term 0.
I20260808 15:56:43.388598 22273 raft_consensus.cc:2454] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44027b256c8447bbb6a9a711c0fd39fc in term 0.
I20260808 15:56:43.388832 21937 leader_election.cc:302] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f84ff123eb74f99964816c18bc93e21, 44027b256c8447bbb6a9a711c0fd39fc; no voters:
I20260808 15:56:43.389041 22439 raft_consensus.cc:2781] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:56:43.389108 22439 raft_consensus.cc:482] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:56:43.389153 22439 raft_consensus.cc:3037] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:43.390089 22439 raft_consensus.cc:504] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.390398 22439 leader_election.cc:288] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [CANDIDATE]: Term 1 election: Requested vote from peers 1f84ff123eb74f99964816c18bc93e21 (127.19.93.1:33325), e817c75f0f9f4081890ea08dafabf7f5 (127.19.93.3:37537)
I20260808 15:56:43.390769 22273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "289681fe6e7c4d97bcedd08c7c4a1da8" candidate_uuid: "44027b256c8447bbb6a9a711c0fd39fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e817c75f0f9f4081890ea08dafabf7f5"
I20260808 15:56:43.390801 21816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "289681fe6e7c4d97bcedd08c7c4a1da8" candidate_uuid: "44027b256c8447bbb6a9a711c0fd39fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f84ff123eb74f99964816c18bc93e21"
I20260808 15:56:43.390900 21816 raft_consensus.cc:3037] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:43.390908 22273 raft_consensus.cc:3037] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:43.392014 21816 raft_consensus.cc:2454] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44027b256c8447bbb6a9a711c0fd39fc in term 1.
I20260808 15:56:43.392014 22273 raft_consensus.cc:2454] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44027b256c8447bbb6a9a711c0fd39fc in term 1.
I20260808 15:56:43.392416 21937 leader_election.cc:302] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f84ff123eb74f99964816c18bc93e21, 44027b256c8447bbb6a9a711c0fd39fc; no voters:
I20260808 15:56:43.392576 22439 raft_consensus.cc:2781] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:43.392653 22439 raft_consensus.cc:686] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [term 1 LEADER]: Becoming Leader. State: Replica: 44027b256c8447bbb6a9a711c0fd39fc, State: Running, Role: LEADER
I20260808 15:56:43.392791 22439 consensus_queue.cc:237] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.394412 21562 catalog_manager.cc:5495] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 44027b256c8447bbb6a9a711c0fd39fc (127.19.93.2). New cstate: current_term: 1 leader_uuid: "44027b256c8447bbb6a9a711c0fd39fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } health_report { overall_health: UNKNOWN } } }
Aug 08 15:56:43 dist-test-slave-lgr5 krb5kdc[21493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:43.446406 22457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.437900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42219 (local address 127.0.0.1:46146)
0808 15:56:43.438174 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:43.438190 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:43.438301 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:43.438559 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:43.438561 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:43.438925 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:43.439018 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.439024 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.440054 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.440057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.440650 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.440659 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.441197 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.441200 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.441258 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.441810 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:43.441822 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:43.443164 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:43.444962 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:43.444971 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:43.444976 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:43.445201 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:43.445478 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:43.445480 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:43.445482 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:43.445563 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:43.445958 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:43.445963 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:43.446062 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 15:56:43.446152 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 15:56:43.446257 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":93,"threads_started":1}
I20260808 15:56:43.446532 21640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.437970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46146 (local address 127.19.93.62:42219)
0808 15:56:43.438135 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:43.438140 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:43.438271 (+ 131us) server_negotiation.cc:407] Connection header received
0808 15:56:43.438388 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:43.438391 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:43.438439 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:43.438531 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:43.439129 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.439939 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.440762 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.441103 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.441196 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.443304 (+ 2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:43.443308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:43.443311 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:43.443337 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:43.444855 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:43.445290 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:43.445293 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:43.445295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:43.445381 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:43.445650 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:43.445653 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:43.445655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:43.445856 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:43.445961 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:43.446222 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 15:56:43.446346 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 15:56:43.450635 21562 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:46146:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 15:56:43.451401 21562 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:56:43.456526 21781 tablet_service.cc:1467] Processing CreateTablet for tablet d38c105e295d41ed8b2ed77b62e0f2db (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=864b0006bc0f4624b349e68f59df75e3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:56:43.456523 22248 tablet_service.cc:1467] Processing CreateTablet for tablet d38c105e295d41ed8b2ed77b62e0f2db (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=864b0006bc0f4624b349e68f59df75e3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:56:43.456910 21781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d38c105e295d41ed8b2ed77b62e0f2db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:43.456912 22248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d38c105e295d41ed8b2ed77b62e0f2db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:43.459443 22389 tablet_bootstrap.cc:492] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21: Bootstrap starting.
I20260808 15:56:43.459784 22019 tablet_service.cc:1467] Processing CreateTablet for tablet d38c105e295d41ed8b2ed77b62e0f2db (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=864b0006bc0f4624b349e68f59df75e3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:56:43.460130 22019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d38c105e295d41ed8b2ed77b62e0f2db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:43.460422 22389 tablet_bootstrap.cc:654] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:43.461572 22389 tablet_bootstrap.cc:492] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21: No bootstrap required, opened a new log
I20260808 15:56:43.461655 22389 ts_tablet_manager.cc:1397] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 15:56:43.462071 22389 raft_consensus.cc:348] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.462198 22389 raft_consensus.cc:374] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:43.462239 22389 raft_consensus.cc:729] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f84ff123eb74f99964816c18bc93e21, State: Initialized, Role: FOLLOWER
I20260808 15:56:43.462355 22389 consensus_queue.cc:260] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.462603 22389 ts_tablet_manager.cc:1428] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:56:43.462670 22391 tablet_bootstrap.cc:492] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5: Bootstrap starting.
I20260808 15:56:43.462666 22399 tablet_replica.cc:439] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } }
I20260808 15:56:43.462795 22399 tablet_replica.cc:442] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:56:43.463554 22391 tablet_bootstrap.cc:654] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:43.464934 22391 tablet_bootstrap.cc:492] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5: No bootstrap required, opened a new log
I20260808 15:56:43.465025 22391 ts_tablet_manager.cc:1397] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 15:56:43.465325 22390 tablet_bootstrap.cc:492] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc: Bootstrap starting.
I20260808 15:56:43.465445 22391 raft_consensus.cc:348] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.465552 22391 raft_consensus.cc:374] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:43.465584 22391 raft_consensus.cc:729] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e817c75f0f9f4081890ea08dafabf7f5, State: Initialized, Role: FOLLOWER
I20260808 15:56:43.465708 22391 consensus_queue.cc:260] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.465973 22391 ts_tablet_manager.cc:1428] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:56:43.466091 22390 tablet_bootstrap.cc:654] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:43.466162 22400 tablet_replica.cc:439] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } }
I20260808 15:56:43.466300 22400 tablet_replica.cc:442] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:56:43.467309 22390 tablet_bootstrap.cc:492] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc: No bootstrap required, opened a new log
I20260808 15:56:43.467403 22390 ts_tablet_manager.cc:1397] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 15:56:43.467758 22390 raft_consensus.cc:348] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.467859 22390 raft_consensus.cc:374] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:43.467881 22390 raft_consensus.cc:729] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44027b256c8447bbb6a9a711c0fd39fc, State: Initialized, Role: FOLLOWER
I20260808 15:56:43.467990 22390 consensus_queue.cc:260] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.468279 22390 ts_tablet_manager.cc:1428] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:56:43.468235 22439 tablet_replica.cc:439] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } }
I20260808 15:56:43.468381 22439 tablet_replica.cc:442] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:56:43.712495 22399 raft_consensus.cc:482] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:56:43.712651 22399 raft_consensus.cc:504] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.713896 22399 leader_election.cc:288] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44027b256c8447bbb6a9a711c0fd39fc (127.19.93.2:44873), e817c75f0f9f4081890ea08dafabf7f5 (127.19.93.3:37537)
I20260808 15:56:43.714350 22439 raft_consensus.cc:482] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:56:43.714478 22439 raft_consensus.cc:504] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.714897 22439 leader_election.cc:288] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f84ff123eb74f99964816c18bc93e21 (127.19.93.1:33325), e817c75f0f9f4081890ea08dafabf7f5 (127.19.93.3:37537)
I20260808 15:56:43.715315 21816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d38c105e295d41ed8b2ed77b62e0f2db" candidate_uuid: "44027b256c8447bbb6a9a711c0fd39fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f84ff123eb74f99964816c18bc93e21" is_pre_election: true
I20260808 15:56:43.715456 21816 raft_consensus.cc:2454] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44027b256c8447bbb6a9a711c0fd39fc in term 0.
I20260808 15:56:43.715438 22273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d38c105e295d41ed8b2ed77b62e0f2db" candidate_uuid: "44027b256c8447bbb6a9a711c0fd39fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e817c75f0f9f4081890ea08dafabf7f5" is_pre_election: true
I20260808 15:56:43.715551 22400 raft_consensus.cc:482] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:56:43.715627 22400 raft_consensus.cc:504] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.715818 21937 leader_election.cc:302] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f84ff123eb74f99964816c18bc93e21, 44027b256c8447bbb6a9a711c0fd39fc; no voters:
I20260808 15:56:43.715999 22439 raft_consensus.cc:2781] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:56:43.716070 22439 raft_consensus.cc:482] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:56:43.716048 22273 raft_consensus.cc:2454] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44027b256c8447bbb6a9a711c0fd39fc in term 0.
I20260808 15:56:43.716130 22439 raft_consensus.cc:3037] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:43.716750 22400 leader_election.cc:288] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f84ff123eb74f99964816c18bc93e21 (127.19.93.1:33325), 44027b256c8447bbb6a9a711c0fd39fc (127.19.93.2:44873)
I20260808 15:56:43.717437 22439 raft_consensus.cc:504] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.717739 22439 leader_election.cc:288] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [CANDIDATE]: Term 1 election: Requested vote from peers 1f84ff123eb74f99964816c18bc93e21 (127.19.93.1:33325), e817c75f0f9f4081890ea08dafabf7f5 (127.19.93.3:37537)
I20260808 15:56:43.718499 22273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d38c105e295d41ed8b2ed77b62e0f2db" candidate_uuid: "44027b256c8447bbb6a9a711c0fd39fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e817c75f0f9f4081890ea08dafabf7f5"
I20260808 15:56:43.718643 22273 raft_consensus.cc:3037] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:43.719594 22383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.714701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:50757 (local address 127.19.93.3:37537)
0808 15:56:43.714823 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:43.714827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:43.715169 (+ 342us) server_negotiation.cc:407] Connection header received
0808 15:56:43.715351 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:43.715354 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:43.715430 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:43.715508 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:43.715834 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.716545 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.718377 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.718967 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.719051 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.719110 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:43.719403 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 15:56:43.719479 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 15:56:43.719754 22273 raft_consensus.cc:2454] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44027b256c8447bbb6a9a711c0fd39fc in term 1.
I20260808 15:56:43.720008 22465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.714572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:37537 (local address 127.19.93.1:50757)
0808 15:56:43.715088 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:43.715101 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:43.715230 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:43.715614 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:43.715617 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:43.715635 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:43.715732 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.715739 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.716962 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.716965 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.718254 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.718263 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.719171 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.719174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.719268 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.719291 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:56:43.719762 (+ 471us) client_negotiation.cc:240] Negotiation successful
0808 15:56:43.719839 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425,"mutex_wait_us":1,"spinlock_wait_cycles":384,"thread_start_us":89,"threads_started":1}
I20260808 15:56:43.720041 21816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d38c105e295d41ed8b2ed77b62e0f2db" candidate_uuid: "44027b256c8447bbb6a9a711c0fd39fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f84ff123eb74f99964816c18bc93e21"
I20260808 15:56:43.720139 22388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.714207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:55477 (local address 127.19.93.2:44873)
0808 15:56:43.714352 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:43.714357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:43.714663 (+ 306us) server_negotiation.cc:407] Connection header received
0808 15:56:43.714885 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:43.714889 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:43.714939 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:43.714989 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:43.716311 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.717012 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.718838 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.719458 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.719536 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.719591 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:43.719917 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 15:56:43.719995 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":49}
I20260808 15:56:43.720186 21816 raft_consensus.cc:3037] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:43.720312 21937 leader_election.cc:302] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44027b256c8447bbb6a9a711c0fd39fc, e817c75f0f9f4081890ea08dafabf7f5; no voters:
I20260808 15:56:43.720482 22439 raft_consensus.cc:2781] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:43.720551 22439 raft_consensus.cc:686] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [term 1 LEADER]: Becoming Leader. State: Replica: 44027b256c8447bbb6a9a711c0fd39fc, State: Running, Role: LEADER
I20260808 15:56:43.720674 22439 consensus_queue.cc:237] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } }
I20260808 15:56:43.720762 22464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.714157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:44873 (local address 127.19.93.1:55477)
0808 15:56:43.714563 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:43.714578 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:43.714750 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:43.715170 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:43.715172 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:43.715194 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:43.715317 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.715323 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.717174 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.717177 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.718692 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.718702 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.719679 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.719682 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.719763 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.719784 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 15:56:43.720535 (+ 751us) client_negotiation.cc:240] Negotiation successful
0808 15:56:43.720608 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":296,"spinlock_wait_cycles":4608,"thread_start_us":106,"threads_started":1}
I20260808 15:56:43.721261 21816 raft_consensus.cc:2454] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44027b256c8447bbb6a9a711c0fd39fc in term 1.
I20260808 15:56:43.722091 22273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d38c105e295d41ed8b2ed77b62e0f2db" candidate_uuid: "1f84ff123eb74f99964816c18bc93e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e817c75f0f9f4081890ea08dafabf7f5" is_pre_election: true
I20260808 15:56:43.722258 22273 raft_consensus.cc:2379] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f84ff123eb74f99964816c18bc93e21 in current term 1: Already voted for candidate 44027b256c8447bbb6a9a711c0fd39fc in this term.
I20260808 15:56:43.722198 22045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d38c105e295d41ed8b2ed77b62e0f2db" candidate_uuid: "1f84ff123eb74f99964816c18bc93e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44027b256c8447bbb6a9a711c0fd39fc" is_pre_election: true
I20260808 15:56:43.722373 22402 tablet_replica.cc:439] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc: TxnStatusTablet state changed. Reason: New leader 44027b256c8447bbb6a9a711c0fd39fc. Latest consensus state: current_term: 1 leader_uuid: "44027b256c8447bbb6a9a711c0fd39fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } }
I20260808 15:56:43.722487 22402 tablet_replica.cc:442] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:56:43.722893 21701 leader_election.cc:302] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f84ff123eb74f99964816c18bc93e21; no voters: 44027b256c8447bbb6a9a711c0fd39fc, e817c75f0f9f4081890ea08dafabf7f5
I20260808 15:56:43.723202 22385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.717891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:40609 (local address 127.19.93.1:33325)
0808 15:56:43.717993 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:43.717997 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:43.718249 (+ 252us) server_negotiation.cc:407] Connection header received
0808 15:56:43.718442 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:43.718446 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:43.718484 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:43.718522 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:43.718875 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.719592 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.721312 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.721896 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.721959 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.722010 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:43.723021 (+ 1011us) server_negotiation.cc:299] Negotiation successful
0808 15:56:43.723093 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:56:43.723315 22399 raft_consensus.cc:2726] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 15:56:43.723578 22467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.717016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:33325 (local address 127.19.93.3:40609)
0808 15:56:43.718163 (+ 1147us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:43.718179 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:43.718321 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:43.718624 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:43.718626 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:43.718642 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:43.718766 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.718774 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.719715 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.719718 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.721193 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.721202 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.722791 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.722794 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.722893 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.722915 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 15:56:43.723371 (+ 456us) client_negotiation.cc:240] Negotiation successful
0808 15:56:43.723444 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1079,"thread_start_us":79,"threads_started":1}
I20260808 15:56:43.723958 22470 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 15:56:43.723984 21816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d38c105e295d41ed8b2ed77b62e0f2db" candidate_uuid: "e817c75f0f9f4081890ea08dafabf7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f84ff123eb74f99964816c18bc93e21" is_pre_election: true
I20260808 15:56:43.724159 21816 raft_consensus.cc:2379] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e817c75f0f9f4081890ea08dafabf7f5 in current term 1: Already voted for candidate 44027b256c8447bbb6a9a711c0fd39fc in this term.
I20260808 15:56:43.724351 22470 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 15:56:43.724362 22388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.717841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:32931 (local address 127.19.93.2:44873)
0808 15:56:43.720292 (+ 2451us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:43.720297 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:43.720308 (+ 11us) server_negotiation.cc:407] Connection header received
0808 15:56:43.720347 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:43.720349 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:43.720393 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:43.720464 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:43.721174 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.721881 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.723174 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.723698 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.723768 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.723818 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:43.724183 (+ 365us) server_negotiation.cc:299] Negotiation successful
0808 15:56:43.724251 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2397,"thread_start_us":83,"threads_started":1}
I20260808 15:56:43.724503 21562 catalog_manager.cc:5495] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 44027b256c8447bbb6a9a711c0fd39fc (127.19.93.2). New cstate: current_term: 1 leader_uuid: "44027b256c8447bbb6a9a711c0fd39fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } health_report { overall_health: UNKNOWN } } }
I20260808 15:56:43.724881 22466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.717355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:44873 (local address 127.19.93.3:32931)
0808 15:56:43.718253 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:43.718265 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:43.718324 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:43.720915 (+ 2591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:43.720918 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:43.720937 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:43.721033 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.721039 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.722020 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.722023 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.723054 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.723063 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.723920 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.723924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.724015 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.724037 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 15:56:43.724669 (+ 632us) client_negotiation.cc:240] Negotiation successful
0808 15:56:43.724741 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":779,"thread_start_us":86,"threads_started":1}
I20260808 15:56:43.725217 22045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d38c105e295d41ed8b2ed77b62e0f2db" candidate_uuid: "e817c75f0f9f4081890ea08dafabf7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44027b256c8447bbb6a9a711c0fd39fc" is_pre_election: true
I20260808 15:56:43.725661 22174 leader_election.cc:302] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e817c75f0f9f4081890ea08dafabf7f5; no voters: 1f84ff123eb74f99964816c18bc93e21, 44027b256c8447bbb6a9a711c0fd39fc
I20260808 15:56:43.726119 22400 raft_consensus.cc:2726] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 15:56:43.760195 22457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.756842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:44873 (local address 127.0.0.1:60662)
0808 15:56:43.756981 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:43.756996 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:43.757126 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:43.757391 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:43.757394 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:43.757402 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:56:43.757493 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.757497 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.758448 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.758451 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.759033 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.759040 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.759570 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.759573 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.759632 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.759674 (+ 42us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:56:43.759931 (+ 257us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:56:43.759939 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 15:56:43.759982 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 15:56:43.760048 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 15:56:43.760190 22388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.756924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60662 (local address 127.19.93.2:44873)
0808 15:56:43.757031 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:43.757036 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:43.757058 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:56:43.757223 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:43.757226 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:43.757274 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:43.757359 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:56:43.757592 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.758352 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.759134 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.759477 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.759565 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.759783 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:56:43.759860 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:56:43.759926 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:43.759995 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 15:56:43.760042 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 15:56:43.762707 22273 raft_consensus.cc:1261] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5 [term 1 FOLLOWER]: Refusing update from remote peer 44027b256c8447bbb6a9a711c0fd39fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:56:43.762724 21816 raft_consensus.cc:1261] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21 [term 1 FOLLOWER]: Refusing update from remote peer 44027b256c8447bbb6a9a711c0fd39fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:56:43.763140 22439 consensus_queue.cc:1035] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:56:43.763305 22402 consensus_queue.cc:1035] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:56:43.764595 22399 tablet_replica.cc:439] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21: TxnStatusTablet state changed. Reason: New leader 44027b256c8447bbb6a9a711c0fd39fc. Latest consensus state: current_term: 1 leader_uuid: "44027b256c8447bbb6a9a711c0fd39fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } }
I20260808 15:56:43.764705 22399 tablet_replica.cc:442] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:56:43.764711 22400 tablet_replica.cc:439] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5: TxnStatusTablet state changed. Reason: New leader 44027b256c8447bbb6a9a711c0fd39fc. Latest consensus state: current_term: 1 leader_uuid: "44027b256c8447bbb6a9a711c0fd39fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } }
I20260808 15:56:43.764820 22400 tablet_replica.cc:442] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:56:43.765921 22402 tablet_replica.cc:439] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "44027b256c8447bbb6a9a711c0fd39fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } }
I20260808 15:56:43.766019 22402 tablet_replica.cc:442] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:56:43.767091 22400 tablet_replica.cc:439] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "44027b256c8447bbb6a9a711c0fd39fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } }
I20260808 15:56:43.767199 22400 tablet_replica.cc:442] T d38c105e295d41ed8b2ed77b62e0f2db P e817c75f0f9f4081890ea08dafabf7f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:56:43.770907 22409 tablet_replica.cc:439] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "44027b256c8447bbb6a9a711c0fd39fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } }
I20260808 15:56:43.771006 22409 tablet_replica.cc:442] T d38c105e295d41ed8b2ed77b62e0f2db P 44027b256c8447bbb6a9a711c0fd39fc: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:56:43.772219 22399 tablet_replica.cc:439] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "44027b256c8447bbb6a9a711c0fd39fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 } } peers { permanent_uuid: "44027b256c8447bbb6a9a711c0fd39fc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44873 } } peers { permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 } } }
I20260808 15:56:43.772336 22399 tablet_replica.cc:442] T d38c105e295d41ed8b2ed77b62e0f2db P 1f84ff123eb74f99964816c18bc93e21: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:56:43.780310 22482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.776728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:44873 (local address 127.19.93.2:59519)
0808 15:56:43.777079 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:43.777091 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:43.777174 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:43.777391 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:43.777393 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:43.777398 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:56:43.777479 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.777483 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.778424 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.778427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.779027 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:43.779036 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.779642 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.779646 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:43.779710 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.779751 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:56:43.780018 (+ 267us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:56:43.780022 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 15:56:43.780070 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 15:56:43.780186 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":1,"thread_start_us":114,"threads_started":1}
I20260808 15:56:43.780319 22388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.776832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:59519 (local address 127.19.93.2:44873)
0808 15:56:43.776944 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:43.776949 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:43.777153 (+ 204us) server_negotiation.cc:407] Connection header received
0808 15:56:43.777251 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:43.777254 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:43.777299 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:43.777383 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:56:43.777560 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.778291 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.779134 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.779509 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.779613 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.779875 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:56:43.779947 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:56:43.780015 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:43.780107 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 15:56:43.780190 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":42}
I20260808 15:56:43.785967 22273 raft_consensus.cc:1261] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5 [term 1 FOLLOWER]: Refusing update from remote peer 44027b256c8447bbb6a9a711c0fd39fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:56:43.785987 21816 raft_consensus.cc:1261] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21 [term 1 FOLLOWER]: Refusing update from remote peer 44027b256c8447bbb6a9a711c0fd39fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:56:43.786353 22439 consensus_queue.cc:1035] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e817c75f0f9f4081890ea08dafabf7f5" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:56:43.786578 22439 consensus_queue.cc:1035] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f84ff123eb74f99964816c18bc93e21" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:56:43.827073 21562 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:56:43.827216 21562 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:56:43.829131 21562 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7d725b8c81904d55a9963d2e2ec8789a: Sending DeleteTablet for 3 replicas of tablet 289681fe6e7c4d97bcedd08c7c4a1da8
I20260808 15:56:43.829620 21781 tablet_service.cc:1514] Processing DeleteTablet for tablet 289681fe6e7c4d97bcedd08c7c4a1da8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:43 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:36102
I20260808 15:56:43.829712 22248 tablet_service.cc:1514] Processing DeleteTablet for tablet 289681fe6e7c4d97bcedd08c7c4a1da8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:43 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:52494
I20260808 15:56:43.829958 22017 tablet_service.cc:1514] Processing DeleteTablet for tablet 289681fe6e7c4d97bcedd08c7c4a1da8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:43 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:60638
I20260808 15:56:43.829906 22488 tablet_replica.cc:330] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21: stopping tablet replica
I20260808 15:56:43.830122 22446 tablet_replica.cc:330] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc: stopping tablet replica
I20260808 15:56:43.830127 22488 raft_consensus.cc:2229] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:56:43.830238 22446 raft_consensus.cc:2229] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:56:43.830241 22488 raft_consensus.cc:2258] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:43.830293 22494 tablet_replica.cc:330] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5: stopping tablet replica
I20260808 15:56:43.830403 22446 raft_consensus.cc:2258] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:43.830400 22494 raft_consensus.cc:2229] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:56:43.830492 22494 raft_consensus.cc:2258] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:43.830957 22488 ts_tablet_manager.cc:1905] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:43.831079 22494 ts_tablet_manager.cc:1905] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:43.831930 22446 ts_tablet_manager.cc:1905] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:43.833827 22488 ts_tablet_manager.cc:1918] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:56:43.833863 22494 ts_tablet_manager.cc:1918] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:56:43.833904 22488 log.cc:1196] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-0/wal/wals/289681fe6e7c4d97bcedd08c7c4a1da8
I20260808 15:56:43.833930 22494 log.cc:1196] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/289681fe6e7c4d97bcedd08c7c4a1da8
I20260808 15:56:43.834156 22488 ts_tablet_manager.cc:1939] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 1f84ff123eb74f99964816c18bc93e21: Deleting consensus metadata
I20260808 15:56:43.834173 22494 ts_tablet_manager.cc:1939] T 289681fe6e7c4d97bcedd08c7c4a1da8 P e817c75f0f9f4081890ea08dafabf7f5: Deleting consensus metadata
I20260808 15:56:43.834580 22446 ts_tablet_manager.cc:1918] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:56:43.834645 22446 log.cc:1196] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/289681fe6e7c4d97bcedd08c7c4a1da8
I20260808 15:56:43.834785 21537 catalog_manager.cc:4841] TS 1f84ff123eb74f99964816c18bc93e21 (127.19.93.1:33325): tablet 289681fe6e7c4d97bcedd08c7c4a1da8 (table test-table [id=ae0d50a6ed4e473ead4c01695940c860]) successfully deleted
I20260808 15:56:43.834925 21537 catalog_manager.cc:4841] TS e817c75f0f9f4081890ea08dafabf7f5 (127.19.93.3:37537): tablet 289681fe6e7c4d97bcedd08c7c4a1da8 (table test-table [id=ae0d50a6ed4e473ead4c01695940c860]) successfully deleted
I20260808 15:56:43.835103 22446 ts_tablet_manager.cc:1939] T 289681fe6e7c4d97bcedd08c7c4a1da8 P 44027b256c8447bbb6a9a711c0fd39fc: Deleting consensus metadata
I20260808 15:56:43.835688 21537 catalog_manager.cc:4841] TS 44027b256c8447bbb6a9a711c0fd39fc (127.19.93.2:44873): tablet 289681fe6e7c4d97bcedd08c7c4a1da8 (table test-table [id=ae0d50a6ed4e473ead4c01695940c860]) successfully deleted
Aug 08 15:56:43 dist-test-slave-lgr5 krb5kdc[21493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204602, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.93.1@KRBTEST.COM
I20260808 15:56:43.845161 22385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.835865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36114 (local address 127.19.93.1:33325)
0808 15:56:43.835991 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:43.835995 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:43.836133 (+ 138us) server_negotiation.cc:407] Connection header received
0808 15:56:43.836264 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:43.836266 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:43.836314 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:43.836400 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:43.837086 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.837871 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.838705 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.839001 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.839113 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.841471 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:43.841482 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:43.841500 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:43.841527 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:43.843409 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:43.843822 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:43.843829 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:43.843831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:43.843928 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:43.844190 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:43.844193 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:43.844195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:43.844519 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:43.844728 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:43.844874 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 15:56:43.844999 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 15:56:43.845580 21888 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36114
I20260808 15:56:43.854499 21640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:43.847302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46158 (local address 127.19.93.62:42219)
0808 15:56:43.847441 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:43.847446 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:43.847460 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:56:43.847554 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:43.847557 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:43.847606 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:43.847691 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:43.848258 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.849031 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.849811 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:43.850134 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:43.850246 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:43.851405 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:43.851409 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:43.851412 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:43.851438 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:43.852956 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:43.853338 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:43.853351 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:43.853353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:43.853442 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:43.853680 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:43.853683 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:43.853684 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:43.853900 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:43.854026 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:43.854223 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 15:56:43.854337 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 15:56:43.854856 21562 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46158
I20260808 15:56:43.856051 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 21677
I20260808 15:56:43.903682 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 21913
I20260808 15:56:43.918337 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 22138
I20260808 15:56:43.925731 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 21511
2026-08-08T15:56:43Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3133 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:56:43 dist-test-slave-lgr5 krb5kdc[22505](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:56:43 dist-test-slave-lgr5 krb5kdc[22505](info): set up 2 sockets
Aug 08 15:56:43 dist-test-slave-lgr5 krb5kdc[22505](info): commencing operation
krb5kdc: starting...
W20260808 15:56:45.073267 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:56:45 dist-test-slave-lgr5 krb5kdc[22505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:56:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:56:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:56:45.193079 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:38433
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:36795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:38433
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:45.302975 22523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:45.303239 22523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:45.303319 22523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:45.307260 22523 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:56:45.307323 22523 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 15:56:45.307353 22523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:45.307382 22523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:45.307418 22523 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:56:45.307451 22523 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:56:45.312678 22523 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:38433
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:38433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:45.313684 22523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:45.314646 22523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:45.322968 22536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:45.322979 22533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:45.323000 22534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:45.323174 22523 server_base.cc:1034] running on GCE node
I20260808 15:56:45.323783 22523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:45.324816 22523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:45.325973 22523 hybrid_clock.cc:648] HybridClock initialized: now 1786204605325954 us; error 31 us; skew 500 ppm
Aug 08 15:56:45 dist-test-slave-lgr5 krb5kdc[22505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204605, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:45.328588 22523 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:56:45.329368 22523 webserver.cc:460] Webserver started at http://127.19.93.62:36433/ using document root <none> and password file <none>
I20260808 15:56:45.329871 22523 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:45.329937 22523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:45.330120 22523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:45.332135 22523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "dfbac108bfda4eb584ed721233359d55"
format_stamp: "Formatted at 2026-08-08 15:56:45 on dist-test-slave-lgr5"
server_key: "c2ff6f627aef8ca10541e04c85c53934"
server_key_iv: "2728167aa62dcc2a4792090a2476cecf"
server_key_version: "encryptionkey@0"
I20260808 15:56:45.332747 22523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "dfbac108bfda4eb584ed721233359d55"
format_stamp: "Formatted at 2026-08-08 15:56:45 on dist-test-slave-lgr5"
server_key: "c2ff6f627aef8ca10541e04c85c53934"
server_key_iv: "2728167aa62dcc2a4792090a2476cecf"
server_key_version: "encryptionkey@0"
I20260808 15:56:45.336444 22523 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:56:45.338975 22547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:45.340185 22523 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:56:45.340334 22523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "dfbac108bfda4eb584ed721233359d55"
format_stamp: "Formatted at 2026-08-08 15:56:45 on dist-test-slave-lgr5"
server_key: "c2ff6f627aef8ca10541e04c85c53934"
server_key_iv: "2728167aa62dcc2a4792090a2476cecf"
server_key_version: "encryptionkey@0"
I20260808 15:56:45.340440 22523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:45.369342 22523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:45.372166 22523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:45.372462 22523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:45.379901 22523 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:38433
I20260808 15:56:45.379943 22649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:38433 every 8 connection(s)
I20260808 15:56:45.380803 22523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:56:45.383451 22651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:45.388749 22651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55: Bootstrap starting.
I20260808 15:56:45.389036 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 22523
I20260808 15:56:45.389144 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:56:45.389412 19828 external_mini_cluster.cc:1428] Setting key e8d5454850c5a68b2f6bca66afef131e
I20260808 15:56:45.391296 22651 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:45.391985 22651 log.cc:824] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55: Log is configured to *not* fsync() on all Append() calls
I20260808 15:56:45.393996 22651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55: No bootstrap required, opened a new log
I20260808 15:56:45.397683 22651 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfbac108bfda4eb584ed721233359d55" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38433 } }
I20260808 15:56:45.397914 22651 raft_consensus.cc:374] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:45.397979 22651 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbac108bfda4eb584ed721233359d55, State: Initialized, Role: FOLLOWER
Aug 08 15:56:45 dist-test-slave-lgr5 krb5kdc[22505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:45.398413 22651 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfbac108bfda4eb584ed721233359d55" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38433 } }
I20260808 15:56:45.398581 22651 raft_consensus.cc:388] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:56:45.398648 22651 raft_consensus.cc:482] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:56:45.398751 22651 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:45.399649 22651 raft_consensus.cc:504] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfbac108bfda4eb584ed721233359d55" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38433 } }
I20260808 15:56:45.399986 22651 leader_election.cc:302] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dfbac108bfda4eb584ed721233359d55; no voters:
I20260808 15:56:45.400283 22651 leader_election.cc:288] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:56:45.400388 22659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:45.400614 22659 raft_consensus.cc:686] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [term 1 LEADER]: Becoming Leader. State: Replica: dfbac108bfda4eb584ed721233359d55, State: Running, Role: LEADER
I20260808 15:56:45.400987 22659 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfbac108bfda4eb584ed721233359d55" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38433 } }
I20260808 15:56:45.401503 22651 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:56:45.402959 22660 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfbac108bfda4eb584ed721233359d55. Latest consensus state: current_term: 1 leader_uuid: "dfbac108bfda4eb584ed721233359d55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfbac108bfda4eb584ed721233359d55" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38433 } } }
I20260808 15:56:45.403076 22660 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [sys.catalog]: This master's current role is: LEADER
I20260808 15:56:45.403975 22655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:45.390699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54172 (local address 127.19.93.62:38433)
0808 15:56:45.391139 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:45.391153 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:45.391187 (+ 34us) server_negotiation.cc:407] Connection header received
0808 15:56:45.391827 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:45.391847 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:45.392222 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:45.392493 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:45.393246 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.394661 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.395557 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.396273 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.396447 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:45.398824 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:45.398829 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:45.398845 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:45.398876 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:45.400784 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:45.401264 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:45.401270 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:45.401275 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:45.401426 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:45.401759 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:45.401763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:45.401765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:45.402200 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:45.402559 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:45.402708 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 15:56:45.403007 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":145,"threads_started":1}
I20260808 15:56:45.404445 22674 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:56:45.404469 22661 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dfbac108bfda4eb584ed721233359d55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfbac108bfda4eb584ed721233359d55" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38433 } } }
I20260808 15:56:45.405102 22661 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55 [sys.catalog]: This master's current role is: LEADER
I20260808 15:56:45.407975 22674 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:56:45.412925 22674 catalog_manager.cc:1347] Generated new cluster ID: de0281c317c3423b98fd74f3b1c5c093
I20260808 15:56:45.412983 22674 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:56:45.423362 22674 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:56:45.424528 22674 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:56:45.431795 22674 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55: Generated new TSK 0
I20260808 15:56:45.432508 22674 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 15:56:45.459095 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:38433
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:36795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:45.568055 22693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:45.568284 22693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:45.568325 22693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:45.572109 22693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:45.572149 22693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:45.572183 22693 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 15:56:45.572201 22693 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:56:45.572229 22693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:56:45.577140 22693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.93.62:38433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:45.577975 22693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:45.578850 22693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:45.587787 22703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:45.587791 22700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:45.587785 22701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:45.587958 22693 server_base.cc:1034] running on GCE node
I20260808 15:56:45.588478 22693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:45.589049 22693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:45.590219 22693 hybrid_clock.cc:648] HybridClock initialized: now 1786204605590206 us; error 28 us; skew 500 ppm
Aug 08 15:56:45 dist-test-slave-lgr5 krb5kdc[22505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204605, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:45.592846 22693 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:56:45.593648 22693 webserver.cc:460] Webserver started at http://127.19.93.1:33047/ using document root <none> and password file <none>
I20260808 15:56:45.594162 22693 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:45.594228 22693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:45.594410 22693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:45.596372 22693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "02d99578b85244d48a79b842e6dec67b"
format_stamp: "Formatted at 2026-08-08 15:56:45 on dist-test-slave-lgr5"
server_key: "f4101a998111bec6b163ca4c913da360"
server_key_iv: "db6dae46ad40ec1efa951a6861c72843"
server_key_version: "encryptionkey@0"
I20260808 15:56:45.596901 22693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "02d99578b85244d48a79b842e6dec67b"
format_stamp: "Formatted at 2026-08-08 15:56:45 on dist-test-slave-lgr5"
server_key: "f4101a998111bec6b163ca4c913da360"
server_key_iv: "db6dae46ad40ec1efa951a6861c72843"
server_key_version: "encryptionkey@0"
I20260808 15:56:45.600319 22693 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260808 15:56:45.602643 22713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:45.603763 22693 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260808 15:56:45.603879 22693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "02d99578b85244d48a79b842e6dec67b"
format_stamp: "Formatted at 2026-08-08 15:56:45 on dist-test-slave-lgr5"
server_key: "f4101a998111bec6b163ca4c913da360"
server_key_iv: "db6dae46ad40ec1efa951a6861c72843"
server_key_version: "encryptionkey@0"
I20260808 15:56:45.603992 22693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:45.659312 22693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:45.662377 22693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:45.662562 22693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:45.663973 22693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:45.664021 22693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:45.664103 22693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:45.664134 22693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:56:45 dist-test-slave-lgr5 krb5kdc[22505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204605, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:45.674528 22693 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:45283
I20260808 15:56:45.674598 22911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:45283 every 8 connection(s)
I20260808 15:56:45.675366 22693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:56:45.676808 22655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:45.664819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:52697 (local address 127.19.93.62:38433)
0808 15:56:45.664941 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:45.664946 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:45.665945 (+ 999us) server_negotiation.cc:407] Connection header received
0808 15:56:45.666853 (+ 908us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:45.666857 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:45.666930 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:45.667012 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:45.668247 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.668842 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.670063 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.670303 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.670399 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:45.673472 (+ 3073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:45.673475 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:45.673477 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:45.673501 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:45.674928 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:45.675407 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:45.675411 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:45.675412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:45.675495 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:45.675834 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:45.675837 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:45.675839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:45.676053 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:45.676164 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:45.676593 (+ 429us) server_negotiation.cc:299] Negotiation successful
0808 15:56:45.676691 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:56:45.677496 22733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:45.665304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:38433 (local address 127.19.93.1:52697)
0808 15:56:45.665787 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:45.665828 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:45.666640 (+ 812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:45.667268 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:45.667277 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:45.667629 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:45.668064 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:45.668103 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.668971 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.668975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:45.669913 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:45.669923 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.670460 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.670465 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:45.670642 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:45.671170 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:45.671185 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:45.673310 (+ 2125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:45.675034 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:45.675039 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:45.675053 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:45.675306 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:45.675585 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:45.675588 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:45.675591 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:45.675720 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:45.676162 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:45.676168 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:45.676377 (+ 209us) client_negotiation.cc:769] Sending connection context
0808 15:56:45.676530 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 15:56:45.676765 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":147,"threads_started":1}
I20260808 15:56:45.678666 22912 heartbeater.cc:347] Connected to a master server at 127.19.93.62:38433
I20260808 15:56:45.678794 22912 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:45.679239 22912 heartbeater.cc:511] Master 127.19.93.62:38433 requested a full tablet report, sending...
I20260808 15:56:45.680830 22570 ts_manager.cc:194] Registered new tserver with Master: 02d99578b85244d48a79b842e6dec67b (127.19.93.1:45283)
I20260808 15:56:45.681941 22570 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:52697
I20260808 15:56:45.685067 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 22693
I20260808 15:56:45.685189 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:56:45.685503 19828 external_mini_cluster.cc:1428] Setting key de3a30b3ab3b94ec9b49e066bb17894a
I20260808 15:56:45.687389 22920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:45.680639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:38433 (local address 127.19.93.1:39959)
0808 15:56:45.680969 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:45.680982 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:45.681077 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:45.681296 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:45.681299 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:45.681469 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:45.681572 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:45.681578 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.682356 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.682359 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:45.682964 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:45.682974 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.683406 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.683410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:45.683505 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:45.683923 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:45.683933 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:45.684269 (+ 336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:45.685955 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:45.685958 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:45.685961 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:45.686188 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:45.686438 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:45.686441 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:45.686443 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:45.686525 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:45.686890 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:45.686894 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:45.686978 (+ 84us) client_negotiation.cc:769] Sending connection context
0808 15:56:45.687062 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 15:56:45.687193 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":1,"thread_start_us":86,"threads_started":1}
I20260808 15:56:45.687403 22655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:45.680720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:39959 (local address 127.19.93.62:38433)
0808 15:56:45.680829 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:45.680832 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:45.681061 (+ 229us) server_negotiation.cc:407] Connection header received
0808 15:56:45.681149 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:45.681152 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:45.681196 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:45.681262 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:45.681683 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.682235 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.683086 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.683301 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.683385 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:45.684395 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:45.684398 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:45.684401 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:45.684426 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:45.685867 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:45.686263 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:45.686267 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:45.686268 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:45.686349 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:45.686622 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:45.686625 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:45.686627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:45.686792 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:45.686876 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:45.687142 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 15:56:45.687241 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 15:56:45.711062 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:38433
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:36795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:45.817730 22923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:45.817975 22923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:45.818039 22923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:45.821964 22923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:45.822021 22923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:45.822073 22923 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 15:56:45.822100 22923 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:56:45.822145 22923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:56:45.827185 22923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.93.62:38433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:45.828224 22923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:45.829222 22923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:45.838541 22940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:45.838570 22937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:45.838553 22934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:45.838752 22923 server_base.cc:1034] running on GCE node
I20260808 15:56:45.839304 22923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:45.839874 22923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:45.841032 22923 hybrid_clock.cc:648] HybridClock initialized: now 1786204605841011 us; error 29 us; skew 500 ppm
Aug 08 15:56:45 dist-test-slave-lgr5 krb5kdc[22505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204605, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:45.843549 22923 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:56:45.844450 22923 webserver.cc:460] Webserver started at http://127.19.93.2:40843/ using document root <none> and password file <none>
I20260808 15:56:45.844986 22923 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:45.845069 22923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:45.845273 22923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:45.847258 22923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "8f7e50e6f9c544169e3a1bc4e309acc7"
format_stamp: "Formatted at 2026-08-08 15:56:45 on dist-test-slave-lgr5"
server_key: "13e488888651a93cb3643e17eb6c8a5b"
server_key_iv: "d69dfe246b439bdb234608896aba3449"
server_key_version: "encryptionkey@0"
I20260808 15:56:45.847796 22923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "8f7e50e6f9c544169e3a1bc4e309acc7"
format_stamp: "Formatted at 2026-08-08 15:56:45 on dist-test-slave-lgr5"
server_key: "13e488888651a93cb3643e17eb6c8a5b"
server_key_iv: "d69dfe246b439bdb234608896aba3449"
server_key_version: "encryptionkey@0"
I20260808 15:56:45.851222 22923 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 15:56:45.853552 22958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:45.854650 22923 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:56:45.854756 22923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "8f7e50e6f9c544169e3a1bc4e309acc7"
format_stamp: "Formatted at 2026-08-08 15:56:45 on dist-test-slave-lgr5"
server_key: "13e488888651a93cb3643e17eb6c8a5b"
server_key_iv: "d69dfe246b439bdb234608896aba3449"
server_key_version: "encryptionkey@0"
I20260808 15:56:45.854851 22923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:45.867233 22923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:45.870034 22923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:45.870213 22923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:45.871582 22923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:45.871628 22923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:45.871680 22923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:45.871711 22923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:56:45 dist-test-slave-lgr5 krb5kdc[22505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204605, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:45.881969 22923 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:40337
I20260808 15:56:45.882653 23168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:40337 every 8 connection(s)
I20260808 15:56:45.882839 22923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:56:45.884562 22655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:45.872425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:34829 (local address 127.19.93.62:38433)
0808 15:56:45.872605 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:45.872611 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:45.873414 (+ 803us) server_negotiation.cc:407] Connection header received
0808 15:56:45.874347 (+ 933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:45.874350 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:45.874408 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:45.874481 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:45.875752 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.876602 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.877835 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.878104 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.878202 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:45.881065 (+ 2863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:45.881068 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:45.881070 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:45.881094 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:45.882538 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:45.883090 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:45.883093 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:45.883094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:45.883181 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:45.883572 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:45.883576 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:45.883577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:45.883776 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:45.883869 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:45.884340 (+ 471us) server_negotiation.cc:299] Negotiation successful
0808 15:56:45.884443 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 15:56:45.885244 22975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:45.872752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:38433 (local address 127.19.93.2:34829)
0808 15:56:45.873227 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:45.873287 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:45.874145 (+ 858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:45.874761 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:45.874770 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:45.875130 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:45.875596 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:45.875615 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.876760 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.876763 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:45.877704 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:45.877715 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.878257 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.878261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:45.878433 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:45.878963 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:45.878986 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:45.880907 (+ 1921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:45.882657 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:45.882663 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:45.882674 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:45.882991 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:45.883286 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:45.883289 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:45.883291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:45.883461 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:45.883859 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:45.883865 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:45.884119 (+ 254us) client_negotiation.cc:769] Sending connection context
0808 15:56:45.884293 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 15:56:45.884521 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":128,"threads_started":1}
I20260808 15:56:45.886297 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 22923
I20260808 15:56:45.886418 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:56:45.886672 19828 external_mini_cluster.cc:1428] Setting key 39cea2a2ac7b8316994e143dc146a071
I20260808 15:56:45.886986 23171 heartbeater.cc:347] Connected to a master server at 127.19.93.62:38433
I20260808 15:56:45.887126 23171 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:45.887574 23171 heartbeater.cc:511] Master 127.19.93.62:38433 requested a full tablet report, sending...
I20260808 15:56:45.888520 22573 ts_manager.cc:194] Registered new tserver with Master: 8f7e50e6f9c544169e3a1bc4e309acc7 (127.19.93.2:40337)
I20260808 15:56:45.889081 22573 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:34829
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
I20260808 15:56:45.896467 22655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:45.888528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:38231 (local address 127.19.93.62:38433)
0808 15:56:45.888628 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:45.888633 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:45.890395 (+ 1762us) server_negotiation.cc:407] Connection header received
0808 15:56:45.890476 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:45.890479 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:45.890521 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:45.890601 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:45.891051 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.891511 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.892343 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.892546 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.892634 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:45.893681 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:45.893685 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:45.893688 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:45.893710 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:45.894904 (+ 1194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:45.895307 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:45.895310 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:45.895312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:45.895384 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:45.895650 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:45.895654 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:45.895655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:45.895849 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:45.895934 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:45.896225 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 15:56:45.896322 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 15:56:45.896481 23186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:45.888440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:38433 (local address 127.19.93.2:38231)
0808 15:56:45.890284 (+ 1844us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:45.890298 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:45.890402 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:45.890630 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:45.890633 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:45.890822 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:45.890934 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:45.890940 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.891642 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.891645 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:45.892235 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:45.892245 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:45.892737 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:45.892740 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:45.892813 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:45.893241 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:45.893251 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:45.893551 (+ 300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:45.895010 (+ 1459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:45.895013 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:45.895015 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:45.895213 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:45.895472 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:45.895475 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:45.895477 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:45.895563 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:45.895950 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:45.895953 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:45.896037 (+ 84us) client_negotiation.cc:769] Sending connection context
0808 15:56:45.896171 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 15:56:45.896302 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1753,"thread_start_us":104,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 15:56:45.914288 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:38433
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:36795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:46.028730 23190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:46.028971 23190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:46.029033 23190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:46.032972 23190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:46.033023 23190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:46.033075 23190 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 15:56:46.033103 23190 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:56:46.033150 23190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:56:46.038304 23190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.93.62:38433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:46.039281 23190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:46.040334 23190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:46.049397 23210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:46.049463 23207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:46.049472 23208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:46.049523 23190 server_base.cc:1034] running on GCE node
I20260808 15:56:46.050022 23190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:46.050639 23190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:46.051800 23190 hybrid_clock.cc:648] HybridClock initialized: now 1786204606051780 us; error 33 us; skew 500 ppm
Aug 08 15:56:46 dist-test-slave-lgr5 krb5kdc[22505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204606, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:46.054487 23190 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:56:46.055313 23190 webserver.cc:460] Webserver started at http://127.19.93.3:35249/ using document root <none> and password file <none>
I20260808 15:56:46.055814 23190 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:46.055871 23190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:46.056035 23190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:46.058008 23190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "6c3042c73a48451fa0de621122878e09"
format_stamp: "Formatted at 2026-08-08 15:56:46 on dist-test-slave-lgr5"
server_key: "277789545f32a9d524abdb286b86a5bf"
server_key_iv: "f3a02830af0cfc9718ae753cbfaaea9f"
server_key_version: "encryptionkey@0"
I20260808 15:56:46.058517 23190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "6c3042c73a48451fa0de621122878e09"
format_stamp: "Formatted at 2026-08-08 15:56:46 on dist-test-slave-lgr5"
server_key: "277789545f32a9d524abdb286b86a5bf"
server_key_iv: "f3a02830af0cfc9718ae753cbfaaea9f"
server_key_version: "encryptionkey@0"
I20260808 15:56:46.061932 23190 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:56:46.064070 23218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:46.065219 23190 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 15:56:46.065311 23190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "6c3042c73a48451fa0de621122878e09"
format_stamp: "Formatted at 2026-08-08 15:56:46 on dist-test-slave-lgr5"
server_key: "277789545f32a9d524abdb286b86a5bf"
server_key_iv: "f3a02830af0cfc9718ae753cbfaaea9f"
server_key_version: "encryptionkey@0"
I20260808 15:56:46.065399 23190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:46.092957 23190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:46.095589 23190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:46.095738 23190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:46.097323 23190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:46.097395 23190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:46.097462 23190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:46.097540 23190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 08 15:56:46 dist-test-slave-lgr5 krb5kdc[22505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204606, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:46.108775 23190 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:42947
I20260808 15:56:46.109755 23190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:56:46.110633 23428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:42947 every 8 connection(s)
I20260808 15:56:46.111089 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 23190
I20260808 15:56:46.111196 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:56:46.111462 19828 external_mini_cluster.cc:1428] Setting key 0d5da37e751883ff0e81f10241ac8f95
I20260808 15:56:46.111622 22655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.097910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:45359 (local address 127.19.93.62:38433)
0808 15:56:46.098034 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.098050 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.099629 (+ 1579us) server_negotiation.cc:407] Connection header received
0808 15:56:46.100685 (+ 1056us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.100689 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.100751 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.100834 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:46.102360 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.102944 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.104069 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.104430 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.104520 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.107666 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:46.107671 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:46.107674 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:46.107704 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:46.109396 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:46.109986 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:46.109990 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:46.109991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:46.110072 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:46.110495 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:46.110500 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:46.110502 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:46.110759 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:46.110863 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.111338 (+ 475us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.111459 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 15:56:46.112485 23231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.099038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:38433 (local address 127.19.93.3:45359)
0808 15:56:46.099482 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.099521 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.100472 (+ 951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.101049 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.101059 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.101495 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:46.102150 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.102172 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.103103 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.103107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.103947 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.103957 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.104595 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.104600 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.104790 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.105281 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:46.105299 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:46.107484 (+ 2185us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:46.109512 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:46.109518 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:46.109530 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:46.109885 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:46.110167 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:46.110171 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:46.110173 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:46.110361 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:46.110875 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:46.110880 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:46.111084 (+ 204us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.111254 (+ 170us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.111557 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":122,"threads_started":1}
I20260808 15:56:46.113761 23430 heartbeater.cc:347] Connected to a master server at 127.19.93.62:38433
I20260808 15:56:46.113903 23430 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:46.114411 23430 heartbeater.cc:511] Master 127.19.93.62:38433 requested a full tablet report, sending...
I20260808 15:56:46.116721 22573 ts_manager.cc:194] Registered new tserver with Master: 6c3042c73a48451fa0de621122878e09 (127.19.93.3:42947)
I20260808 15:56:46.117519 22573 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:45359
I20260808 15:56:46.125241 22655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.117162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:51257 (local address 127.19.93.62:38433)
0808 15:56:46.117277 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.117281 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.117294 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:56:46.117326 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.117329 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.117371 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.117482 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:46.118409 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.119165 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.120345 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.120691 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.120806 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.121804 (+ 998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:46.121809 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:46.121812 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:46.121841 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:46.123423 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:46.123883 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:46.123887 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:46.123888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:46.124120 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:46.124480 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:46.124484 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:46.124486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:46.124658 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:46.124745 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.125000 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.125096 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 15:56:46.125253 23440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.115779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:38433 (local address 127.19.93.3:51257)
0808 15:56:46.116099 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.116114 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.116204 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.117600 (+ 1396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.117602 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.117871 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:46.118282 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.118292 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.119322 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.119325 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.120206 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.120215 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.120797 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.120799 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.120884 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.121345 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:46.121357 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:46.121667 (+ 310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:46.123564 (+ 1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:46.123567 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:46.123568 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:46.123783 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:46.124218 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:46.124221 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:46.124223 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:46.124318 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:46.124749 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:46.124753 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:46.124833 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.124933 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.125065 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":107,"threads_started":1}
I20260808 15:56:46.126149 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 15:56:46 dist-test-slave-lgr5 krb5kdc[22505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 15:56:46 dist-test-slave-lgr5 krb5kdc[22505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:46.153385 22655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.145463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54188 (local address 127.19.93.62:38433)
0808 15:56:46.145599 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.145602 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.145615 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:56:46.145653 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.145655 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.145692 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.145761 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:46.146447 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.146969 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.147780 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.148005 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.148130 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.150557 (+ 2427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:46.150560 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:46.150562 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:46.150587 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:46.151757 (+ 1170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:46.152171 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:46.152175 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:46.152177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:46.152256 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:46.152501 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:46.152505 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:46.152507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:46.152675 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:46.152789 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.153096 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.153206 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 15:56:46.156044 22573 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54188:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:56:46.159164 22573 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:56:46.172890 23454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.167000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:45283 (local address 127.0.0.1:49906)
0808 15:56:46.167651 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.167699 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.167822 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.168943 (+ 1121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.168945 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.168959 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:46.169036 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.169041 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.170238 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.170242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.171350 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.171360 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.172377 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.172381 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.172489 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.172531 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.172634 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.172749 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":68,"threads_started":1}
I20260808 15:56:46.173131 23459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.167090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:40337 (local address 127.0.0.1:36294)
0808 15:56:46.168268 (+ 1178us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.168281 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.168429 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.168877 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.168883 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.168907 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:46.169033 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.169050 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.170363 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.170367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.171548 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.171559 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.172771 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.172774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.172854 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.172875 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.172937 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.172997 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1076,"thread_start_us":95,"threads_started":1}
I20260808 15:56:46.173183 23458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.167182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49906 (local address 127.19.93.1:45283)
0808 15:56:46.168576 (+ 1394us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.168590 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.168607 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:56:46.168666 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.168670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.168805 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.169185 (+ 380us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:46.169320 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.170132 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.171469 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.172211 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.172315 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.172473 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.172973 (+ 500us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.173060 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1284,"thread_start_us":84,"threads_started":1}
I20260808 15:56:46.173220 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.167822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40726 (local address 127.19.93.3:42947)
0808 15:56:46.168307 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.168317 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.168342 (+ 25us) server_negotiation.cc:407] Connection header received
0808 15:56:46.168515 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.168521 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.168719 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.168872 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:46.169441 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.170497 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.171805 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.172389 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.172489 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.172640 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.172800 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.172901 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":120,"threads_started":1}
I20260808 15:56:46.173530 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.167736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36294 (local address 127.19.93.2:40337)
0808 15:56:46.168136 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.168148 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.168358 (+ 210us) server_negotiation.cc:407] Connection header received
0808 15:56:46.168549 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.168554 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.168719 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.168872 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:46.169139 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.170236 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.171668 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.172467 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.172562 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.172713 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.173303 (+ 590us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.173393 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":136,"threads_started":1}
I20260808 15:56:46.173697 23455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.167422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:42947 (local address 127.0.0.1:40726)
0808 15:56:46.168271 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.168284 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.168369 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.169154 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.169156 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.169195 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:46.169326 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.169334 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.170611 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.170614 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.171701 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.171709 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.172569 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.172573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.172659 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.172683 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.172762 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.172832 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":773,"thread_start_us":82,"threads_started":1}
I20260808 15:56:46.175810 22798 tablet_service.cc:1467] Processing CreateTablet for tablet e71c25bd9b4b4a3ea8527c43eccfc63c (DEFAULT_TABLE table=test-table [id=5867050f74384bee8275123241c252e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:46.176180 23056 tablet_service.cc:1467] Processing CreateTablet for tablet e71c25bd9b4b4a3ea8527c43eccfc63c (DEFAULT_TABLE table=test-table [id=5867050f74384bee8275123241c252e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:46.176265 23304 tablet_service.cc:1467] Processing CreateTablet for tablet e71c25bd9b4b4a3ea8527c43eccfc63c (DEFAULT_TABLE table=test-table [id=5867050f74384bee8275123241c252e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:46.176831 22798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e71c25bd9b4b4a3ea8527c43eccfc63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:46.177170 23056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e71c25bd9b4b4a3ea8527c43eccfc63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:46.177178 23304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e71c25bd9b4b4a3ea8527c43eccfc63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:46.183629 23464 tablet_bootstrap.cc:492] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b: Bootstrap starting.
I20260808 15:56:46.184329 23468 tablet_bootstrap.cc:492] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7: Bootstrap starting.
I20260808 15:56:46.184746 23465 tablet_bootstrap.cc:492] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09: Bootstrap starting.
I20260808 15:56:46.186540 23468 tablet_bootstrap.cc:654] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:46.186513 23464 tablet_bootstrap.cc:654] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:46.186827 23465 tablet_bootstrap.cc:654] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:46.187278 23468 log.cc:824] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7: Log is configured to *not* fsync() on all Append() calls
I20260808 15:56:46.187376 23464 log.cc:824] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b: Log is configured to *not* fsync() on all Append() calls
I20260808 15:56:46.187574 23465 log.cc:824] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09: Log is configured to *not* fsync() on all Append() calls
I20260808 15:56:46.189167 23468 tablet_bootstrap.cc:492] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7: No bootstrap required, opened a new log
I20260808 15:56:46.189257 23464 tablet_bootstrap.cc:492] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b: No bootstrap required, opened a new log
I20260808 15:56:46.189333 23468 ts_tablet_manager.cc:1397] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 15:56:46.189430 23464 ts_tablet_manager.cc:1397] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:56:46.192054 23468 raft_consensus.cc:348] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.192116 23464 raft_consensus.cc:348] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.192301 23468 raft_consensus.cc:374] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:46.192312 23464 raft_consensus.cc:374] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:46.192361 23468 raft_consensus.cc:729] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f7e50e6f9c544169e3a1bc4e309acc7, State: Initialized, Role: FOLLOWER
I20260808 15:56:46.192369 23464 raft_consensus.cc:729] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02d99578b85244d48a79b842e6dec67b, State: Initialized, Role: FOLLOWER
I20260808 15:56:46.192732 23468 consensus_queue.cc:260] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.192741 23464 consensus_queue.cc:260] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.193320 23171 heartbeater.cc:503] Master 127.19.93.62:38433 was elected leader, sending a full tablet report...
I20260808 15:56:46.193583 23468 ts_tablet_manager.cc:1428] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7: Time spent starting tablet: real 0.004s user 0.002s sys 0.003s
I20260808 15:56:46.193621 23464 ts_tablet_manager.cc:1428] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260808 15:56:46.194425 22912 heartbeater.cc:503] Master 127.19.93.62:38433 was elected leader, sending a full tablet report...
I20260808 15:56:46.195314 23465 tablet_bootstrap.cc:492] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09: No bootstrap required, opened a new log
I20260808 15:56:46.195544 23465 ts_tablet_manager.cc:1397] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260808 15:56:46.198727 23465 raft_consensus.cc:348] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.198932 23465 raft_consensus.cc:374] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:46.198979 23465 raft_consensus.cc:729] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c3042c73a48451fa0de621122878e09, State: Initialized, Role: FOLLOWER
I20260808 15:56:46.199321 23465 consensus_queue.cc:260] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.199877 23430 heartbeater.cc:503] Master 127.19.93.62:38433 was elected leader, sending a full tablet report...
I20260808 15:56:46.200066 23465 ts_tablet_manager.cc:1428] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260808 15:56:46.307808 23477 raft_consensus.cc:482] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:56:46.308037 23477 raft_consensus.cc:504] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.309269 23477 leader_election.cc:288] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02d99578b85244d48a79b842e6dec67b (127.19.93.1:45283), 8f7e50e6f9c544169e3a1bc4e309acc7 (127.19.93.2:40337)
I20260808 15:56:46.313548 23231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.309538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:45283 (local address 127.19.93.3:55205)
0808 15:56:46.309734 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.309750 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.309860 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.310167 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.310170 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.310190 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:46.310323 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.310331 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.311278 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.311281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.312283 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.312293 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.313093 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.313096 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.313202 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.313230 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.313308 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.313379 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107}
I20260808 15:56:46.313599 23458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.309590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:55205 (local address 127.19.93.1:45283)
0808 15:56:46.309737 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.309742 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.309943 (+ 201us) server_negotiation.cc:407] Connection header received
0808 15:56:46.310014 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.310018 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.310075 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.310146 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:46.310453 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.311173 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.312422 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.312974 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.313061 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.313148 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.313355 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.313466 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 15:56:46.313961 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.309770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:52715 (local address 127.19.93.2:40337)
0808 15:56:46.309887 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.309891 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.310079 (+ 188us) server_negotiation.cc:407] Connection header received
0808 15:56:46.310190 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.310193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.310242 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.310319 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:46.311059 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.311714 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.312864 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.313366 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.313462 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.313516 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.313756 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.313835 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:56:46.314337 23478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.309587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:40337 (local address 127.19.93.3:52715)
0808 15:56:46.309982 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.309995 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.310095 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.310339 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.310341 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.310357 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:46.310927 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.310939 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.311833 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.311836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.312741 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.312752 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.313493 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.313496 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.313599 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.313622 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.314098 (+ 476us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.314173 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":158,"threads_started":1}
I20260808 15:56:46.314548 22843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e71c25bd9b4b4a3ea8527c43eccfc63c" candidate_uuid: "6c3042c73a48451fa0de621122878e09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d99578b85244d48a79b842e6dec67b" is_pre_election: true
I20260808 15:56:46.314932 22843 raft_consensus.cc:2454] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c3042c73a48451fa0de621122878e09 in term 0.
I20260808 15:56:46.315001 23089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e71c25bd9b4b4a3ea8527c43eccfc63c" candidate_uuid: "6c3042c73a48451fa0de621122878e09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" is_pre_election: true
I20260808 15:56:46.315296 23089 raft_consensus.cc:2454] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c3042c73a48451fa0de621122878e09 in term 0.
I20260808 15:56:46.315481 23223 leader_election.cc:302] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d99578b85244d48a79b842e6dec67b, 6c3042c73a48451fa0de621122878e09; no voters:
I20260808 15:56:46.315800 23477 raft_consensus.cc:2781] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:56:46.315922 23477 raft_consensus.cc:482] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:56:46.315979 23477 raft_consensus.cc:3037] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:46.317030 23477 raft_consensus.cc:504] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.317332 23477 leader_election.cc:288] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [CANDIDATE]: Term 1 election: Requested vote from peers 02d99578b85244d48a79b842e6dec67b (127.19.93.1:45283), 8f7e50e6f9c544169e3a1bc4e309acc7 (127.19.93.2:40337)
I20260808 15:56:46.317690 22843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e71c25bd9b4b4a3ea8527c43eccfc63c" candidate_uuid: "6c3042c73a48451fa0de621122878e09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d99578b85244d48a79b842e6dec67b"
I20260808 15:56:46.317690 23089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e71c25bd9b4b4a3ea8527c43eccfc63c" candidate_uuid: "6c3042c73a48451fa0de621122878e09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7"
I20260808 15:56:46.317808 22843 raft_consensus.cc:3037] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:46.317808 23089 raft_consensus.cc:3037] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:46.319079 22843 raft_consensus.cc:2454] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c3042c73a48451fa0de621122878e09 in term 1.
I20260808 15:56:46.319377 23223 leader_election.cc:302] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d99578b85244d48a79b842e6dec67b, 6c3042c73a48451fa0de621122878e09; no voters:
I20260808 15:56:46.319466 23089 raft_consensus.cc:2454] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c3042c73a48451fa0de621122878e09 in term 1.
I20260808 15:56:46.319553 23477 raft_consensus.cc:2781] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:46.319785 23477 raft_consensus.cc:686] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [term 1 LEADER]: Becoming Leader. State: Replica: 6c3042c73a48451fa0de621122878e09, State: Running, Role: LEADER
I20260808 15:56:46.320147 23477 consensus_queue.cc:237] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.323179 22569 catalog_manager.cc:5495] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c3042c73a48451fa0de621122878e09 (127.19.93.3). New cstate: current_term: 1 leader_uuid: "6c3042c73a48451fa0de621122878e09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } health_report { overall_health: HEALTHY } } }
W20260808 15:56:46.360841 23431 tablet.cc:2369] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 15:56:46 dist-test-slave-lgr5 krb5kdc[22505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204605, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:46.377466 23499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.369625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:38433 (local address 127.0.0.1:54204)
0808 15:56:46.369933 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.369945 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.370051 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.370273 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.370275 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.370688 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:46.370783 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.370791 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.371518 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.371522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.372066 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.372074 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.372501 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.372505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.372639 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.373150 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:46.373161 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:46.374513 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:46.375934 (+ 1421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:46.375944 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:46.375950 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:46.376230 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:46.376478 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:46.376481 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:46.376483 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:46.376569 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:46.376919 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:46.376926 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:46.377030 (+ 104us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.377127 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.377278 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":39,"thread_start_us":114,"threads_started":1}
I20260808 15:56:46.377465 22655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.369691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54204 (local address 127.19.93.62:38433)
0808 15:56:46.369838 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.369842 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.370018 (+ 176us) server_negotiation.cc:407] Connection header received
0808 15:56:46.370137 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.370139 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.370178 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.370237 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:46.370904 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.371414 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.372202 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.372404 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.372488 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.374652 (+ 2164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:46.374655 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:46.374657 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:46.374679 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:46.375834 (+ 1155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:46.376317 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:46.376321 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:46.376322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:46.376396 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:46.376648 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:46.376652 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:46.376653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:46.376818 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:46.376903 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.377189 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.377328 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":51}
I20260808 15:56:46.381184 22569 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:54204:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 15:56:46.381879 22569 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 15:56:46.384262 23174 tablet.cc:2369] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:56:46.386735 23056 tablet_service.cc:1467] Processing CreateTablet for tablet 2c11c2fc1a674c0ea29ddde37ad8f0be (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b2f716b90cb7488fa5f266173a0d175d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:56:46.386641 22798 tablet_service.cc:1467] Processing CreateTablet for tablet 2c11c2fc1a674c0ea29ddde37ad8f0be (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b2f716b90cb7488fa5f266173a0d175d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:56:46.387331 22798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c11c2fc1a674c0ea29ddde37ad8f0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:46.387331 23056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c11c2fc1a674c0ea29ddde37ad8f0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:46.387054 23304 tablet_service.cc:1467] Processing CreateTablet for tablet 2c11c2fc1a674c0ea29ddde37ad8f0be (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b2f716b90cb7488fa5f266173a0d175d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:56:46.387672 23304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c11c2fc1a674c0ea29ddde37ad8f0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:46.390173 23464 tablet_bootstrap.cc:492] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b: Bootstrap starting.
I20260808 15:56:46.390347 23465 tablet_bootstrap.cc:492] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09: Bootstrap starting.
I20260808 15:56:46.391026 23464 tablet_bootstrap.cc:654] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:46.391256 23465 tablet_bootstrap.cc:654] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:46.391736 23468 tablet_bootstrap.cc:492] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7: Bootstrap starting.
I20260808 15:56:46.392511 23465 tablet_bootstrap.cc:492] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09: No bootstrap required, opened a new log
I20260808 15:56:46.392576 23465 ts_tablet_manager.cc:1397] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 15:56:46.392611 23468 tablet_bootstrap.cc:654] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:46.392982 23465 raft_consensus.cc:348] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.393083 23465 raft_consensus.cc:374] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:46.393110 23465 raft_consensus.cc:729] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c3042c73a48451fa0de621122878e09, State: Initialized, Role: FOLLOWER
I20260808 15:56:46.393215 23465 consensus_queue.cc:260] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.393457 23464 tablet_bootstrap.cc:492] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b: No bootstrap required, opened a new log
I20260808 15:56:46.393535 23464 ts_tablet_manager.cc:1397] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 15:56:46.393457 23477 tablet_replica.cc:439] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } } }
I20260808 15:56:46.393463 23465 ts_tablet_manager.cc:1428] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 15:56:46.393608 23477 tablet_replica.cc:442] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:56:46.393931 23464 raft_consensus.cc:348] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.394017 23464 raft_consensus.cc:374] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:46.394037 23464 raft_consensus.cc:729] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02d99578b85244d48a79b842e6dec67b, State: Initialized, Role: FOLLOWER
I20260808 15:56:46.394162 23464 consensus_queue.cc:260] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.394410 23464 ts_tablet_manager.cc:1428] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:56:46.394424 23468 tablet_bootstrap.cc:492] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7: No bootstrap required, opened a new log
I20260808 15:56:46.394414 23474 tablet_replica.cc:439] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } } }
I20260808 15:56:46.394503 23468 ts_tablet_manager.cc:1397] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 15:56:46.394565 23474 tablet_replica.cc:442] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:56:46.394963 23468 raft_consensus.cc:348] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.395084 23468 raft_consensus.cc:374] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:46.395123 23468 raft_consensus.cc:729] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f7e50e6f9c544169e3a1bc4e309acc7, State: Initialized, Role: FOLLOWER
I20260808 15:56:46.395232 23468 consensus_queue.cc:260] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.395467 23468 ts_tablet_manager.cc:1428] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:56:46.395467 23475 tablet_replica.cc:439] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } } }
I20260808 15:56:46.395679 23475 tablet_replica.cc:442] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7: This TxnStatusTablet replica's current role is: FOLLOWER
W20260808 15:56:46.426637 22913 tablet.cc:2369] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:56:46.595943 23475 raft_consensus.cc:482] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:56:46.596134 23475 raft_consensus.cc:504] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.597232 23475 leader_election.cc:288] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02d99578b85244d48a79b842e6dec67b (127.19.93.1:45283), 6c3042c73a48451fa0de621122878e09 (127.19.93.3:42947)
I20260808 15:56:46.600855 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.597590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:49249 (local address 127.19.93.3:42947)
0808 15:56:46.597709 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.597714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.597967 (+ 253us) server_negotiation.cc:407] Connection header received
0808 15:56:46.598088 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.598092 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.598137 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.598199 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:46.598448 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.598950 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.599914 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.600327 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.600420 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.600485 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.600671 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.600740 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 15:56:46.600874 23506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.597476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:42947 (local address 127.19.93.2:49249)
0808 15:56:46.597881 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.597892 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.597985 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.598224 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.598227 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.598242 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:46.598347 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.598353 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.599057 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.599060 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.599798 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.599806 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.600436 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.600440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.600561 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.600580 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.600642 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.600709 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"mutex_wait_us":5,"thread_start_us":64,"threads_started":1}
I20260808 15:56:46.600905 23458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.597564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:55757 (local address 127.19.93.1:45283)
0808 15:56:46.597690 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.597695 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.597843 (+ 148us) server_negotiation.cc:407] Connection header received
0808 15:56:46.597976 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.597979 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.598019 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.598089 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:46.598345 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.598832 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.599909 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.600344 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.600440 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.600500 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.600721 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.600791 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 15:56:46.600929 23505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.597438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:45283 (local address 127.19.93.2:55757)
0808 15:56:46.597761 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.597773 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.597876 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.598115 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.598117 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.598135 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:46.598245 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.598250 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.598933 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.598936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.599787 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.599796 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.600462 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.600466 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.600607 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.600626 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.600692 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.600758 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":99,"thread_start_us":97,"threads_started":1}
I20260808 15:56:46.601326 22843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c11c2fc1a674c0ea29ddde37ad8f0be" candidate_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d99578b85244d48a79b842e6dec67b" is_pre_election: true
I20260808 15:56:46.601406 23345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c11c2fc1a674c0ea29ddde37ad8f0be" candidate_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c3042c73a48451fa0de621122878e09" is_pre_election: true
I20260808 15:56:46.601476 22843 raft_consensus.cc:2454] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f7e50e6f9c544169e3a1bc4e309acc7 in term 0.
I20260808 15:56:46.601629 23345 raft_consensus.cc:2454] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f7e50e6f9c544169e3a1bc4e309acc7 in term 0.
I20260808 15:56:46.601794 22965 leader_election.cc:302] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d99578b85244d48a79b842e6dec67b, 8f7e50e6f9c544169e3a1bc4e309acc7; no voters:
I20260808 15:56:46.602066 23475 raft_consensus.cc:2781] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:56:46.602121 23475 raft_consensus.cc:482] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:56:46.602149 23475 raft_consensus.cc:3037] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:46.603178 23475 raft_consensus.cc:504] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.603502 23475 leader_election.cc:288] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [CANDIDATE]: Term 1 election: Requested vote from peers 02d99578b85244d48a79b842e6dec67b (127.19.93.1:45283), 6c3042c73a48451fa0de621122878e09 (127.19.93.3:42947)
I20260808 15:56:46.603794 22843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c11c2fc1a674c0ea29ddde37ad8f0be" candidate_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d99578b85244d48a79b842e6dec67b"
I20260808 15:56:46.603837 23345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c11c2fc1a674c0ea29ddde37ad8f0be" candidate_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c3042c73a48451fa0de621122878e09"
I20260808 15:56:46.603902 22843 raft_consensus.cc:3037] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:46.603922 23345 raft_consensus.cc:3037] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:46.604856 22843 raft_consensus.cc:2454] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f7e50e6f9c544169e3a1bc4e309acc7 in term 1.
I20260808 15:56:46.604921 23345 raft_consensus.cc:2454] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f7e50e6f9c544169e3a1bc4e309acc7 in term 1.
I20260808 15:56:46.605103 22965 leader_election.cc:302] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d99578b85244d48a79b842e6dec67b, 8f7e50e6f9c544169e3a1bc4e309acc7; no voters:
I20260808 15:56:46.605273 23475 raft_consensus.cc:2781] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:46.605430 23475 raft_consensus.cc:686] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 LEADER]: Becoming Leader. State: Replica: 8f7e50e6f9c544169e3a1bc4e309acc7, State: Running, Role: LEADER
I20260808 15:56:46.605726 23475 consensus_queue.cc:237] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.607883 23507 tablet_replica.cc:439] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7: TxnStatusTablet state changed. Reason: New leader 8f7e50e6f9c544169e3a1bc4e309acc7. Latest consensus state: current_term: 1 leader_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } } }
I20260808 15:56:46.607992 23507 tablet_replica.cc:442] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:56:46.608304 23513 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 15:56:46.608557 23513 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 15:56:46.609057 22569 catalog_manager.cc:5495] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f7e50e6f9c544169e3a1bc4e309acc7 (127.19.93.2). New cstate: current_term: 1 leader_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } health_report { overall_health: UNKNOWN } } }
I20260808 15:56:46.634301 23499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.630538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:40337 (local address 127.0.0.1:36296)
0808 15:56:46.630667 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.630681 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.630770 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.631051 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.631054 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.631060 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:56:46.631143 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.631147 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.632125 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.632129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.632722 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.632731 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.633281 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.633284 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.633360 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.633407 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:56:46.634078 (+ 671us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:56:46.634086 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.634124 (+ 38us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.634194 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 15:56:46.634316 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.630638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36296 (local address 127.19.93.2:40337)
0808 15:56:46.630751 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.630755 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.630769 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:56:46.630891 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.630894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.630951 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.631049 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:56:46.631231 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.631991 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.632829 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.633181 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.633279 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.633546 (+ 267us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:56:46.633999 (+ 453us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:56:46.634109 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.634141 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.634195 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:56:46.638860 23345 raft_consensus.cc:1261] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09 [term 1 FOLLOWER]: Refusing update from remote peer 8f7e50e6f9c544169e3a1bc4e309acc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:56:46.638973 22843 raft_consensus.cc:1261] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b [term 1 FOLLOWER]: Refusing update from remote peer 8f7e50e6f9c544169e3a1bc4e309acc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:56:46.639463 23475 consensus_queue.cc:1035] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:56:46.639631 23507 consensus_queue.cc:1035] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:56:46.642704 23477 tablet_replica.cc:439] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09: TxnStatusTablet state changed. Reason: New leader 8f7e50e6f9c544169e3a1bc4e309acc7. Latest consensus state: current_term: 1 leader_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } } }
I20260808 15:56:46.642815 23477 tablet_replica.cc:442] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:56:46.643244 23474 tablet_replica.cc:439] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b: TxnStatusTablet state changed. Reason: New leader 8f7e50e6f9c544169e3a1bc4e309acc7. Latest consensus state: current_term: 1 leader_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } } }
I20260808 15:56:46.643348 23474 tablet_replica.cc:442] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:56:46.645435 23475 tablet_replica.cc:439] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } } }
I20260808 15:56:46.645541 23475 tablet_replica.cc:442] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:56:46.645961 23517 mvcc.cc:205] Tried to move back new op lower bound from 7316294068786741248 to 7316294068659257344. Current Snapshot: MvccSnapshot[applied={T|T < 7316294068786741248}]
I20260808 15:56:46.646497 23475 tablet_replica.cc:439] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } } }
I20260808 15:56:46.646605 23475 tablet_replica.cc:442] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 8f7e50e6f9c544169e3a1bc4e309acc7: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:56:46.647044 23477 tablet_replica.cc:439] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } } }
I20260808 15:56:46.647140 23477 tablet_replica.cc:442] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 6c3042c73a48451fa0de621122878e09: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:56:46.648339 23474 tablet_replica.cc:439] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } } }
I20260808 15:56:46.648439 23474 tablet_replica.cc:442] T 2c11c2fc1a674c0ea29ddde37ad8f0be P 02d99578b85244d48a79b842e6dec67b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:56:46.648671 23520 mvcc.cc:205] Tried to move back new op lower bound from 7316294068786741248 to 7316294068659257344. Current Snapshot: MvccSnapshot[applied={T|T < 7316294068786741248 or (T in {7316294068786741248})}]
I20260808 15:56:46.659511 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.655463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40734 (local address 127.19.93.3:42947)
0808 15:56:46.655566 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.655569 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.655803 (+ 234us) server_negotiation.cc:407] Connection header received
0808 15:56:46.655950 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.655952 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.656008 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.656126 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:56:46.656396 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.656904 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.658118 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.658349 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.658424 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.658730 (+ 306us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:56:46.659131 (+ 401us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:56:46.659207 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.659367 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.659415 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 15:56:46.669575 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.666168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:34145 (local address 127.19.93.2:40337)
0808 15:56:46.666278 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.666282 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.666442 (+ 160us) server_negotiation.cc:407] Connection header received
0808 15:56:46.666547 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.666550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.666597 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.666655 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:56:46.666875 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.667333 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.668582 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.668823 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.668907 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.669231 (+ 324us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:56:46.669291 (+ 60us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:56:46.669339 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.669444 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.669484 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 15:56:46.669657 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.666055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:40337 (local address 127.19.93.3:34145)
0808 15:56:46.666362 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.666376 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.666474 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.666677 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.666680 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.666687 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:56:46.666789 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.666794 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.667429 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.667433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.668453 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.668464 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.668943 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.668948 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.669044 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.669093 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:56:46.669369 (+ 276us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:56:46.669375 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.669434 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.669507 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":103,"threads_started":1}
I20260808 15:56:46.676756 22843 raft_consensus.cc:1261] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b [term 1 FOLLOWER]: Refusing update from remote peer 6c3042c73a48451fa0de621122878e09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:56:46.677160 23089 raft_consensus.cc:1261] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Refusing update from remote peer 6c3042c73a48451fa0de621122878e09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:56:46.677521 23477 consensus_queue.cc:1035] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:56:46.677670 23479 consensus_queue.cc:1035] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:56:46.684785 23519 mvcc.cc:205] Tried to move back new op lower bound from 7316294068943654912 to 7316294067489902592. Current Snapshot: MvccSnapshot[applied={T|T < 7316294068943654912}]
I20260808 15:56:46.702229 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.698959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:59233 (local address 127.19.93.3:42947)
0808 15:56:46.699056 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.699060 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.699072 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:56:46.699184 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.699187 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.699237 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.699282 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:56:46.699625 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.700269 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.701089 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.701299 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.701397 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.701788 (+ 391us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:56:46.701872 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:56:46.701937 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.702056 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.702103 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 15:56:46.702246 23544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.698659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:42947 (local address 127.19.93.2:59233)
0808 15:56:46.698951 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.698966 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.699059 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.699403 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.699405 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.699416 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:56:46.699515 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.699522 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.700376 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.700380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.700977 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.700986 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.701441 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.701445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.701540 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.701628 (+ 88us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:56:46.701958 (+ 330us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:56:46.701965 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.702026 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.702105 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":85,"threads_started":1}
I20260808 15:56:46.726608 22573 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:56:46.726770 22573 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:56:46.729017 22573 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55: Sending DeleteTablet for 3 replicas of tablet e71c25bd9b4b4a3ea8527c43eccfc63c
I20260808 15:56:46.729643 22798 tablet_service.cc:1514] Processing DeleteTablet for tablet e71c25bd9b4b4a3ea8527c43eccfc63c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:46 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:49906
I20260808 15:56:46.729899 23304 tablet_service.cc:1514] Processing DeleteTablet for tablet e71c25bd9b4b4a3ea8527c43eccfc63c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:46 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:40726
I20260808 15:56:46.730237 23551 tablet_replica.cc:330] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b: stopping tablet replica
I20260808 15:56:46.730453 23056 tablet_service.cc:1514] Processing DeleteTablet for tablet e71c25bd9b4b4a3ea8527c43eccfc63c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:46 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:36294
I20260808 15:56:46.730664 23551 raft_consensus.cc:2229] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:56:46.730912 23551 raft_consensus.cc:2258] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:46.731524 22573 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54188:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:56:46.731940 22573 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:56:46.732606 23551 ts_tablet_manager.cc:1905] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:46.735756 23551 ts_tablet_manager.cc:1918] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:56:46.735926 23551 log.cc:1196] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/wal/wals/e71c25bd9b4b4a3ea8527c43eccfc63c
I20260808 15:56:46.736332 23551 ts_tablet_manager.cc:1939] T e71c25bd9b4b4a3ea8527c43eccfc63c P 02d99578b85244d48a79b842e6dec67b: Deleting consensus metadata
I20260808 15:56:46.737063 22798 tablet_service.cc:1467] Processing CreateTablet for tablet f3d4e8069a5c45309eed382c72debb60 (DEFAULT_TABLE table=test-table [id=a58150f6cec0463faf8ad398a618dcb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:46.737311 22798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3d4e8069a5c45309eed382c72debb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:46.737706 22554 catalog_manager.cc:4841] TS 02d99578b85244d48a79b842e6dec67b (127.19.93.1:45283): tablet e71c25bd9b4b4a3ea8527c43eccfc63c (table test-table [id=5867050f74384bee8275123241c252e6]) successfully deleted
I20260808 15:56:46.739044 23464 tablet_bootstrap.cc:492] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b: Bootstrap starting.
I20260808 15:56:46.739568 23304 tablet_service.cc:1467] Processing CreateTablet for tablet f3d4e8069a5c45309eed382c72debb60 (DEFAULT_TABLE table=test-table [id=a58150f6cec0463faf8ad398a618dcb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:46.739825 23304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3d4e8069a5c45309eed382c72debb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:46.739941 23464 tablet_bootstrap.cc:654] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:46.741324 23464 tablet_bootstrap.cc:492] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b: No bootstrap required, opened a new log
I20260808 15:56:46.741418 23464 ts_tablet_manager.cc:1397] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 15:56:46.741812 23464 raft_consensus.cc:348] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.741920 23464 raft_consensus.cc:374] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:46.741951 23464 raft_consensus.cc:729] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02d99578b85244d48a79b842e6dec67b, State: Initialized, Role: FOLLOWER
I20260808 15:56:46.742063 23464 consensus_queue.cc:260] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.742301 23464 ts_tablet_manager.cc:1428] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 15:56:46.742406 23056 tablet_service.cc:1467] Processing CreateTablet for tablet f3d4e8069a5c45309eed382c72debb60 (DEFAULT_TABLE table=test-table [id=a58150f6cec0463faf8ad398a618dcb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:46.742683 23056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3d4e8069a5c45309eed382c72debb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:46.745045 23468 tablet_bootstrap.cc:492] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7: Bootstrap starting.
I20260808 15:56:46.746006 23465 tablet_bootstrap.cc:492] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09: Bootstrap starting.
I20260808 15:56:46.746351 23468 tablet_bootstrap.cc:654] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:46.746896 23465 tablet_bootstrap.cc:654] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:46.747080 23474 raft_consensus.cc:482] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:56:46.747164 23474 raft_consensus.cc:504] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.748308 23474 leader_election.cc:288] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f7e50e6f9c544169e3a1bc4e309acc7 (127.19.93.2:40337), 6c3042c73a48451fa0de621122878e09 (127.19.93.3:42947)
I20260808 15:56:46.748801 23465 tablet_bootstrap.cc:492] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09: No bootstrap required, opened a new log
I20260808 15:56:46.748889 23465 ts_tablet_manager.cc:1397] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260808 15:56:46.749344 23465 raft_consensus.cc:348] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.749457 23465 raft_consensus.cc:374] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:46.749491 23465 raft_consensus.cc:729] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c3042c73a48451fa0de621122878e09, State: Initialized, Role: FOLLOWER
I20260808 15:56:46.749605 23465 consensus_queue.cc:260] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.749869 23465 ts_tablet_manager.cc:1428] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 15:56:46.752352 23552 tablet_replica.cc:330] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09: stopping tablet replica
I20260808 15:56:46.752664 23552 raft_consensus.cc:2229] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:56:46.753026 23552 raft_consensus.cc:2258] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:46.753137 23468 tablet_bootstrap.cc:492] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7: No bootstrap required, opened a new log
I20260808 15:56:46.753206 23468 ts_tablet_manager.cc:1397] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.001s
I20260808 15:56:46.753364 23554 tablet_replica.cc:330] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7: stopping tablet replica
I20260808 15:56:46.753621 23468 raft_consensus.cc:348] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.754498 23468 raft_consensus.cc:374] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:46.754539 23468 raft_consensus.cc:729] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f7e50e6f9c544169e3a1bc4e309acc7, State: Initialized, Role: FOLLOWER
I20260808 15:56:46.754652 23468 consensus_queue.cc:260] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.754930 23468 ts_tablet_manager.cc:1428] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 15:56:46.753610 23554 raft_consensus.cc:2229] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:56:46.755159 23554 raft_consensus.cc:2258] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:46.756320 23552 ts_tablet_manager.cc:1905] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:46.758131 23554 ts_tablet_manager.cc:1905] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:46.759831 23559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.748620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:40337 (local address 127.19.93.1:51187)
0808 15:56:46.750075 (+ 1455us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.750089 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.750229 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.750590 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.750593 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.750611 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:46.750721 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.750729 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.751676 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.751679 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.754435 (+ 2756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.754446 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.759112 (+ 4666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.759115 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.759231 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.759256 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.759626 (+ 370us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.759702 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1389,"thread_start_us":107,"threads_started":1}
I20260808 15:56:46.759577 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.748950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:51187 (local address 127.19.93.2:40337)
0808 15:56:46.749062 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.749067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.750158 (+ 1091us) server_negotiation.cc:407] Connection header received
0808 15:56:46.750343 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.750346 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.750404 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.750451 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:46.750840 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.751535 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.758298 (+ 6763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.758854 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.758934 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.758997 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.759390 (+ 393us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.759467 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:56:46.760442 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.749732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:56481 (local address 127.19.93.3:42947)
0808 15:56:46.749830 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.749834 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.756349 (+ 6515us) server_negotiation.cc:407] Connection header received
0808 15:56:46.756521 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.756524 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.756564 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.756606 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:56:46.756961 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.757669 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.759178 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.759775 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.759860 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.759917 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.760266 (+ 349us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.760333 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 15:56:46.760562 23089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3d4e8069a5c45309eed382c72debb60" candidate_uuid: "02d99578b85244d48a79b842e6dec67b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" is_pre_election: true
I20260808 15:56:46.760674 23089 raft_consensus.cc:2454] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02d99578b85244d48a79b842e6dec67b in term 0.
I20260808 15:56:46.760805 23558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.749353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:42947 (local address 127.19.93.1:56481)
0808 15:56:46.756263 (+ 6910us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.756277 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.756414 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.756725 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.756728 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.756742 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:56:46.756849 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.756855 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.757882 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.757886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.759039 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.759051 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.760009 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.760012 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.760135 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.760158 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.760599 (+ 441us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.760672 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6843,"thread_start_us":98,"threads_started":1}
I20260808 15:56:46.761193 23345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3d4e8069a5c45309eed382c72debb60" candidate_uuid: "02d99578b85244d48a79b842e6dec67b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c3042c73a48451fa0de621122878e09" is_pre_election: true
I20260808 15:56:46.761310 23345 raft_consensus.cc:2454] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02d99578b85244d48a79b842e6dec67b in term 0.
I20260808 15:56:46.761370 22721 leader_election.cc:302] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d99578b85244d48a79b842e6dec67b, 8f7e50e6f9c544169e3a1bc4e309acc7; no voters:
I20260808 15:56:46.761612 23474 raft_consensus.cc:2781] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:56:46.761660 23474 raft_consensus.cc:482] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:56:46.761694 23474 raft_consensus.cc:3037] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:46.762379 23552 ts_tablet_manager.cc:1918] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:56:46.762458 23552 log.cc:1196] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/e71c25bd9b4b4a3ea8527c43eccfc63c
I20260808 15:56:46.762763 23552 ts_tablet_manager.cc:1939] T e71c25bd9b4b4a3ea8527c43eccfc63c P 6c3042c73a48451fa0de621122878e09: Deleting consensus metadata
I20260808 15:56:46.763187 23474 raft_consensus.cc:504] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.763541 23474 leader_election.cc:288] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [CANDIDATE]: Term 1 election: Requested vote from peers 8f7e50e6f9c544169e3a1bc4e309acc7 (127.19.93.2:40337), 6c3042c73a48451fa0de621122878e09 (127.19.93.3:42947)
I20260808 15:56:46.763916 23345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3d4e8069a5c45309eed382c72debb60" candidate_uuid: "02d99578b85244d48a79b842e6dec67b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c3042c73a48451fa0de621122878e09"
I20260808 15:56:46.764016 23345 raft_consensus.cc:3037] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:46.764619 22550 catalog_manager.cc:4841] TS 6c3042c73a48451fa0de621122878e09 (127.19.93.3:42947): tablet e71c25bd9b4b4a3ea8527c43eccfc63c (table test-table [id=5867050f74384bee8275123241c252e6]) successfully deleted
I20260808 15:56:46.764958 23345 raft_consensus.cc:2454] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d99578b85244d48a79b842e6dec67b in term 1.
I20260808 15:56:46.765267 22718 leader_election.cc:302] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d99578b85244d48a79b842e6dec67b, 6c3042c73a48451fa0de621122878e09; no voters:
I20260808 15:56:46.765566 23474 raft_consensus.cc:2781] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:46.765605 23089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3d4e8069a5c45309eed382c72debb60" candidate_uuid: "02d99578b85244d48a79b842e6dec67b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7"
I20260808 15:56:46.765702 23089 raft_consensus.cc:3037] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:46.765748 23474 raft_consensus.cc:686] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [term 1 LEADER]: Becoming Leader. State: Replica: 02d99578b85244d48a79b842e6dec67b, State: Running, Role: LEADER
I20260808 15:56:46.765952 23474 consensus_queue.cc:237] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:46.766724 23089 raft_consensus.cc:2454] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d99578b85244d48a79b842e6dec67b in term 1.
I20260808 15:56:46.768060 22573 catalog_manager.cc:5495] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b reported cstate change: term changed from 0 to 1, leader changed from <none> to 02d99578b85244d48a79b842e6dec67b (127.19.93.1). New cstate: current_term: 1 leader_uuid: "02d99578b85244d48a79b842e6dec67b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } health_report { overall_health: UNKNOWN } } }
I20260808 15:56:46.770108 23554 ts_tablet_manager.cc:1918] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:56:46.770885 23554 log.cc:1196] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/e71c25bd9b4b4a3ea8527c43eccfc63c
I20260808 15:56:46.771286 23554 ts_tablet_manager.cc:1939] T e71c25bd9b4b4a3ea8527c43eccfc63c P 8f7e50e6f9c544169e3a1bc4e309acc7: Deleting consensus metadata
I20260808 15:56:46.772275 22552 catalog_manager.cc:4841] TS 8f7e50e6f9c544169e3a1bc4e309acc7 (127.19.93.2:40337): tablet e71c25bd9b4b4a3ea8527c43eccfc63c (table test-table [id=5867050f74384bee8275123241c252e6]) successfully deleted
I20260808 15:56:46.788378 23458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.784742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49914 (local address 127.19.93.1:45283)
0808 15:56:46.784844 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.784848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.784921 (+ 73us) server_negotiation.cc:407] Connection header received
0808 15:56:46.785070 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.785073 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.785118 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.785208 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:56:46.785451 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.786084 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.786976 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.787247 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.787334 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.787597 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:56:46.788010 (+ 413us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:56:46.788143 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.788206 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.788258 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 15:56:46.797922 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.794536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:38159 (local address 127.19.93.2:40337)
0808 15:56:46.794635 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.794638 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.794876 (+ 238us) server_negotiation.cc:407] Connection header received
0808 15:56:46.794988 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.794990 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.795028 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.795100 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:56:46.795334 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.795820 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.797014 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.797227 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.797299 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.797581 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:56:46.797641 (+ 60us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:56:46.797687 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.797783 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.797825 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 15:56:46.798024 23567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.794459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:40337 (local address 127.19.93.1:38159)
0808 15:56:46.794788 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.794802 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.794916 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.795138 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.795141 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.795148 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:56:46.795253 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.795258 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.795918 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.795921 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.796886 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.796896 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.797325 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.797329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.797424 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.797472 (+ 48us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:56:46.797711 (+ 239us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:56:46.797716 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.797774 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.797853 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":89,"threads_started":1}
I20260808 15:56:46.803442 23089 raft_consensus.cc:1261] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Refusing update from remote peer 02d99578b85244d48a79b842e6dec67b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:56:46.803459 23345 raft_consensus.cc:1261] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09 [term 1 FOLLOWER]: Refusing update from remote peer 02d99578b85244d48a79b842e6dec67b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:56:46.803869 23474 consensus_queue.cc:1035] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:56:46.804037 23560 consensus_queue.cc:1035] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:56:46.822710 23458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.819706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:45829 (local address 127.19.93.1:45283)
0808 15:56:46.819811 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:46.819815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:46.819825 (+ 10us) server_negotiation.cc:407] Connection header received
0808 15:56:46.819859 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:46.819861 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:46.819898 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:46.819961 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:56:46.820220 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.820813 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.821608 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.821822 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.821913 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.822131 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:56:46.822209 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:56:46.822275 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:46.822546 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 15:56:46.822595 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 15:56:46.822718 23544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:46.819500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:45283 (local address 127.19.93.2:45829)
0808 15:56:46.819647 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:46.819662 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:46.819734 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:46.819990 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:46.819993 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:46.820002 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:56:46.820120 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.820127 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.820937 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.820940 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.821498 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:46.821505 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:46.821919 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:46.821922 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:46.822001 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:46.822030 (+ 29us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:56:46.822430 (+ 400us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:56:46.822437 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 15:56:46.822511 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 15:56:46.822590 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 15:56:46.823370 23519 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 15:56:48.380964 22570 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:56:48.381114 22570 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:56:48.383438 22570 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55: Sending DeleteTablet for 3 replicas of tablet f3d4e8069a5c45309eed382c72debb60
I20260808 15:56:48.383926 22798 tablet_service.cc:1514] Processing DeleteTablet for tablet f3d4e8069a5c45309eed382c72debb60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:48 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:49906
I20260808 15:56:48.384188 23304 tablet_service.cc:1514] Processing DeleteTablet for tablet f3d4e8069a5c45309eed382c72debb60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:48 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:40726
I20260808 15:56:48.386441 23056 tablet_service.cc:1514] Processing DeleteTablet for tablet f3d4e8069a5c45309eed382c72debb60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:48 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:36294
I20260808 15:56:48.387696 23612 tablet_replica.cc:330] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7: stopping tablet replica
I20260808 15:56:48.387822 23612 raft_consensus.cc:2229] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:56:48.387948 23612 raft_consensus.cc:2258] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:48.388180 23606 tablet_replica.cc:330] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09: stopping tablet replica
I20260808 15:56:48.388214 23605 tablet_replica.cc:330] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b: stopping tablet replica
I20260808 15:56:48.388306 23606 raft_consensus.cc:2229] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:56:48.388331 23605 raft_consensus.cc:2229] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:56:48.388413 23606 raft_consensus.cc:2258] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:48.388599 23605 raft_consensus.cc:2258] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:48.388888 23612 ts_tablet_manager.cc:1905] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:48.389145 23605 ts_tablet_manager.cc:1905] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:48.390980 23612 ts_tablet_manager.cc:1918] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 15:56:48.391048 23612 log.cc:1196] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/f3d4e8069a5c45309eed382c72debb60
I20260808 15:56:48.391259 23612 ts_tablet_manager.cc:1939] T f3d4e8069a5c45309eed382c72debb60 P 8f7e50e6f9c544169e3a1bc4e309acc7: Deleting consensus metadata
I20260808 15:56:48.391718 23605 ts_tablet_manager.cc:1918] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 15:56:48.391795 23605 log.cc:1196] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/wal/wals/f3d4e8069a5c45309eed382c72debb60
I20260808 15:56:48.392117 23605 ts_tablet_manager.cc:1939] T f3d4e8069a5c45309eed382c72debb60 P 02d99578b85244d48a79b842e6dec67b: Deleting consensus metadata
I20260808 15:56:48.392129 23606 ts_tablet_manager.cc:1905] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:48.392769 22554 catalog_manager.cc:4841] TS 02d99578b85244d48a79b842e6dec67b (127.19.93.1:45283): tablet f3d4e8069a5c45309eed382c72debb60 (table test-table [id=a58150f6cec0463faf8ad398a618dcb7]) successfully deleted
I20260808 15:56:48.394487 23606 ts_tablet_manager.cc:1918] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 15:56:48.394565 23606 log.cc:1196] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/f3d4e8069a5c45309eed382c72debb60
I20260808 15:56:48.394763 23606 ts_tablet_manager.cc:1939] T f3d4e8069a5c45309eed382c72debb60 P 6c3042c73a48451fa0de621122878e09: Deleting consensus metadata
I20260808 15:56:48.395372 22550 catalog_manager.cc:4841] TS 6c3042c73a48451fa0de621122878e09 (127.19.93.3:42947): tablet f3d4e8069a5c45309eed382c72debb60 (table test-table [id=a58150f6cec0463faf8ad398a618dcb7]) successfully deleted
I20260808 15:56:48.395627 22552 catalog_manager.cc:4841] TS 8f7e50e6f9c544169e3a1bc4e309acc7 (127.19.93.2:40337): tablet f3d4e8069a5c45309eed382c72debb60 (table test-table [id=a58150f6cec0463faf8ad398a618dcb7]) successfully deleted
Aug 08 15:56:48 dist-test-slave-lgr5 krb5kdc[22505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204608, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 15:56:48 dist-test-slave-lgr5 krb5kdc[22505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204608, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:48.412456 23621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:48.404774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54216 (local address 127.19.93.62:38433)
0808 15:56:48.405010 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:48.405017 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:48.405030 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:56:48.405136 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:48.405139 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:48.405178 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:48.405251 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:48.405850 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:48.406383 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:48.407234 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:48.407458 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:48.407534 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:48.409752 (+ 2218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:48.409755 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:48.409758 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:48.409782 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:48.411138 (+ 1356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:48.411456 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:48.411459 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:48.411460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:48.411534 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:48.411722 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:48.411724 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:48.411725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:48.411889 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:48.411985 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:48.412235 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 15:56:48.412331 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":82,"threads_started":1}
I20260808 15:56:48.414863 22570 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54216:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:56:48.415283 22570 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:56:48.419610 22798 tablet_service.cc:1467] Processing CreateTablet for tablet 24c22a68ecac49e5925738c7d23656fd (DEFAULT_TABLE table=test-table [id=a1922881527b43768156eeaa98bc9ab2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:48.419724 23056 tablet_service.cc:1467] Processing CreateTablet for tablet 24c22a68ecac49e5925738c7d23656fd (DEFAULT_TABLE table=test-table [id=a1922881527b43768156eeaa98bc9ab2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:48.419756 23304 tablet_service.cc:1467] Processing CreateTablet for tablet 24c22a68ecac49e5925738c7d23656fd (DEFAULT_TABLE table=test-table [id=a1922881527b43768156eeaa98bc9ab2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:48.419909 22798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24c22a68ecac49e5925738c7d23656fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:48.419984 23304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24c22a68ecac49e5925738c7d23656fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:48.420007 23056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24c22a68ecac49e5925738c7d23656fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:48.421972 23622 tablet_bootstrap.cc:492] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7: Bootstrap starting.
I20260808 15:56:48.422377 23625 tablet_bootstrap.cc:492] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b: Bootstrap starting.
I20260808 15:56:48.422653 23624 tablet_bootstrap.cc:492] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09: Bootstrap starting.
I20260808 15:56:48.422991 23622 tablet_bootstrap.cc:654] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:48.423226 23625 tablet_bootstrap.cc:654] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:48.423431 23624 tablet_bootstrap.cc:654] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:48.424042 23622 tablet_bootstrap.cc:492] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7: No bootstrap required, opened a new log
I20260808 15:56:48.424145 23622 ts_tablet_manager.cc:1397] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 15:56:48.424496 23624 tablet_bootstrap.cc:492] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09: No bootstrap required, opened a new log
I20260808 15:56:48.424497 23622 raft_consensus.cc:348] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.424576 23624 ts_tablet_manager.cc:1397] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 15:56:48.424602 23622 raft_consensus.cc:374] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:48.424641 23622 raft_consensus.cc:729] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f7e50e6f9c544169e3a1bc4e309acc7, State: Initialized, Role: FOLLOWER
I20260808 15:56:48.424765 23622 consensus_queue.cc:260] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.425046 23622 ts_tablet_manager.cc:1428] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 15:56:48.425376 23624 raft_consensus.cc:348] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.425496 23624 raft_consensus.cc:374] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:48.425547 23624 raft_consensus.cc:729] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c3042c73a48451fa0de621122878e09, State: Initialized, Role: FOLLOWER
I20260808 15:56:48.425675 23624 consensus_queue.cc:260] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.425801 23625 tablet_bootstrap.cc:492] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b: No bootstrap required, opened a new log
I20260808 15:56:48.425890 23625 ts_tablet_manager.cc:1397] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260808 15:56:48.426044 23624 ts_tablet_manager.cc:1428] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:56:48.426303 23625 raft_consensus.cc:348] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.426427 23625 raft_consensus.cc:374] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:48.426466 23625 raft_consensus.cc:729] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02d99578b85244d48a79b842e6dec67b, State: Initialized, Role: FOLLOWER
I20260808 15:56:48.426584 23625 consensus_queue.cc:260] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.426841 23625 ts_tablet_manager.cc:1428] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:56:48.525219 23599 raft_consensus.cc:482] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:56:48.525342 23599 raft_consensus.cc:504] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.525738 23599 leader_election.cc:288] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02d99578b85244d48a79b842e6dec67b (127.19.93.1:45283), 6c3042c73a48451fa0de621122878e09 (127.19.93.3:42947)
I20260808 15:56:48.526139 22843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24c22a68ecac49e5925738c7d23656fd" candidate_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d99578b85244d48a79b842e6dec67b" is_pre_election: true
I20260808 15:56:48.526208 23344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24c22a68ecac49e5925738c7d23656fd" candidate_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c3042c73a48451fa0de621122878e09" is_pre_election: true
I20260808 15:56:48.526296 22843 raft_consensus.cc:2454] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f7e50e6f9c544169e3a1bc4e309acc7 in term 0.
I20260808 15:56:48.526353 23344 raft_consensus.cc:2454] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f7e50e6f9c544169e3a1bc4e309acc7 in term 0.
I20260808 15:56:48.526656 22965 leader_election.cc:302] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d99578b85244d48a79b842e6dec67b, 8f7e50e6f9c544169e3a1bc4e309acc7; no voters:
I20260808 15:56:48.526836 23599 raft_consensus.cc:2781] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:56:48.526911 23599 raft_consensus.cc:482] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:56:48.526938 23599 raft_consensus.cc:3037] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:48.527894 23599 raft_consensus.cc:504] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.528204 23599 leader_election.cc:288] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [CANDIDATE]: Term 1 election: Requested vote from peers 02d99578b85244d48a79b842e6dec67b (127.19.93.1:45283), 6c3042c73a48451fa0de621122878e09 (127.19.93.3:42947)
I20260808 15:56:48.528520 22843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24c22a68ecac49e5925738c7d23656fd" candidate_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d99578b85244d48a79b842e6dec67b"
I20260808 15:56:48.528548 23344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24c22a68ecac49e5925738c7d23656fd" candidate_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c3042c73a48451fa0de621122878e09"
I20260808 15:56:48.528632 22843 raft_consensus.cc:3037] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:48.528652 23344 raft_consensus.cc:3037] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:48.529484 22843 raft_consensus.cc:2454] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f7e50e6f9c544169e3a1bc4e309acc7 in term 1.
I20260808 15:56:48.529598 23344 raft_consensus.cc:2454] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f7e50e6f9c544169e3a1bc4e309acc7 in term 1.
I20260808 15:56:48.529731 22965 leader_election.cc:302] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d99578b85244d48a79b842e6dec67b, 8f7e50e6f9c544169e3a1bc4e309acc7; no voters:
I20260808 15:56:48.529891 23599 raft_consensus.cc:2781] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:48.529979 23599 raft_consensus.cc:686] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 LEADER]: Becoming Leader. State: Replica: 8f7e50e6f9c544169e3a1bc4e309acc7, State: Running, Role: LEADER
I20260808 15:56:48.530128 23599 consensus_queue.cc:237] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.531785 22573 catalog_manager.cc:5495] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f7e50e6f9c544169e3a1bc4e309acc7 (127.19.93.2). New cstate: current_term: 1 leader_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } health_report { overall_health: UNKNOWN } } }
I20260808 15:56:48.553974 23644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:48.551036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36312 (local address 127.19.93.2:40337)
0808 15:56:48.551305 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:48.551315 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:48.551331 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:56:48.551375 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:48.551377 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:48.551421 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:48.551500 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:56:48.551699 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:48.552242 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:48.553081 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:48.553305 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:48.553389 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:48.553575 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:56:48.553650 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:56:48.553716 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:48.553783 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 15:56:48.553831 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":115,"threads_started":1}
I20260808 15:56:48.562053 23644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:48.559477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:43629 (local address 127.19.93.2:40337)
0808 15:56:48.559604 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:48.559607 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:48.559689 (+ 82us) server_negotiation.cc:407] Connection header received
0808 15:56:48.559776 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:48.559778 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:48.559815 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:48.559873 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:56:48.560046 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:48.560533 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:48.561284 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:48.561484 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:48.561560 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:48.561729 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:56:48.561786 (+ 57us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:56:48.561833 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:48.561910 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 15:56:48.561950 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:56:48.562076 23647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:48.559338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:40337 (local address 127.19.93.2:43629)
0808 15:56:48.559617 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:48.559629 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:48.559711 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:48.559895 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:48.559898 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:48.559903 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:56:48.559975 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:48.559978 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:48.560623 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:48.560625 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:48.561197 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:48.561205 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:48.561564 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:48.561566 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:48.561623 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:48.561645 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:56:48.561843 (+ 198us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:56:48.561847 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 15:56:48.561901 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 15:56:48.561957 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":98,"threads_started":1}
I20260808 15:56:48.566860 23344 raft_consensus.cc:1261] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09 [term 1 FOLLOWER]: Refusing update from remote peer 8f7e50e6f9c544169e3a1bc4e309acc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:56:48.566926 22843 raft_consensus.cc:1261] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b [term 1 FOLLOWER]: Refusing update from remote peer 8f7e50e6f9c544169e3a1bc4e309acc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:56:48.567274 23578 consensus_queue.cc:1035] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:56:48.567472 23587 consensus_queue.cc:1035] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:56:48.597929 22570 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:56:48.598109 22570 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:56:48.600128 22570 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55: Sending DeleteTablet for 3 replicas of tablet 24c22a68ecac49e5925738c7d23656fd
I20260808 15:56:48.600638 23055 tablet_service.cc:1514] Processing DeleteTablet for tablet 24c22a68ecac49e5925738c7d23656fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:48 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:36294
I20260808 15:56:48.600646 22798 tablet_service.cc:1514] Processing DeleteTablet for tablet 24c22a68ecac49e5925738c7d23656fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:48 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:49906
I20260808 15:56:48.600705 23304 tablet_service.cc:1514] Processing DeleteTablet for tablet 24c22a68ecac49e5925738c7d23656fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:48 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:40726
I20260808 15:56:48.600807 23612 tablet_replica.cc:330] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7: stopping tablet replica
I20260808 15:56:48.600896 23605 tablet_replica.cc:330] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b: stopping tablet replica
I20260808 15:56:48.600915 23612 raft_consensus.cc:2229] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:56:48.601016 23605 raft_consensus.cc:2229] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:56:48.601125 23605 raft_consensus.cc:2258] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:48.601174 23612 raft_consensus.cc:2258] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:48.601286 23606 tablet_replica.cc:330] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09: stopping tablet replica
I20260808 15:56:48.601397 23606 raft_consensus.cc:2229] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:56:48.601518 23606 raft_consensus.cc:2258] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:48.601838 23612 ts_tablet_manager.cc:1905] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:48.602177 23606 ts_tablet_manager.cc:1905] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:48.602402 23605 ts_tablet_manager.cc:1905] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:48.604624 23606 ts_tablet_manager.cc:1918] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:56:48.604694 23606 log.cc:1196] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/24c22a68ecac49e5925738c7d23656fd
I20260808 15:56:48.604943 23606 ts_tablet_manager.cc:1939] T 24c22a68ecac49e5925738c7d23656fd P 6c3042c73a48451fa0de621122878e09: Deleting consensus metadata
I20260808 15:56:48.604996 23605 ts_tablet_manager.cc:1918] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:56:48.605059 23605 log.cc:1196] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-0/wal/wals/24c22a68ecac49e5925738c7d23656fd
I20260808 15:56:48.605273 23612 ts_tablet_manager.cc:1918] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:56:48.605295 23605 ts_tablet_manager.cc:1939] T 24c22a68ecac49e5925738c7d23656fd P 02d99578b85244d48a79b842e6dec67b: Deleting consensus metadata
I20260808 15:56:48.605336 23612 log.cc:1196] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/24c22a68ecac49e5925738c7d23656fd
I20260808 15:56:48.605574 23612 ts_tablet_manager.cc:1939] T 24c22a68ecac49e5925738c7d23656fd P 8f7e50e6f9c544169e3a1bc4e309acc7: Deleting consensus metadata
I20260808 15:56:48.605858 22550 catalog_manager.cc:4841] TS 6c3042c73a48451fa0de621122878e09 (127.19.93.3:42947): tablet 24c22a68ecac49e5925738c7d23656fd (table test-table [id=a1922881527b43768156eeaa98bc9ab2]) successfully deleted
I20260808 15:56:48.605876 22554 catalog_manager.cc:4841] TS 02d99578b85244d48a79b842e6dec67b (127.19.93.1:45283): tablet 24c22a68ecac49e5925738c7d23656fd (table test-table [id=a1922881527b43768156eeaa98bc9ab2]) successfully deleted
I20260808 15:56:48.606432 22552 catalog_manager.cc:4841] TS 8f7e50e6f9c544169e3a1bc4e309acc7 (127.19.93.2:40337): tablet 24c22a68ecac49e5925738c7d23656fd (table test-table [id=a1922881527b43768156eeaa98bc9ab2]) successfully deleted
I20260808 15:56:48.606455 22570 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54216:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:56:48.606840 22570 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:56:48.611245 23055 tablet_service.cc:1467] Processing CreateTablet for tablet 46e9756841074b7c8905dfc791d0d944 (DEFAULT_TABLE table=test-table [id=b492a2acd85741dbac1527bfb57e6565]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:48.611254 22798 tablet_service.cc:1467] Processing CreateTablet for tablet 46e9756841074b7c8905dfc791d0d944 (DEFAULT_TABLE table=test-table [id=b492a2acd85741dbac1527bfb57e6565]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:48.611501 23055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46e9756841074b7c8905dfc791d0d944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:48.611524 22798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46e9756841074b7c8905dfc791d0d944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:48.613289 23304 tablet_service.cc:1467] Processing CreateTablet for tablet 46e9756841074b7c8905dfc791d0d944 (DEFAULT_TABLE table=test-table [id=b492a2acd85741dbac1527bfb57e6565]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:56:48.613459 23625 tablet_bootstrap.cc:492] T 46e9756841074b7c8905dfc791d0d944 P 02d99578b85244d48a79b842e6dec67b: Bootstrap starting.
I20260808 15:56:48.613514 23304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46e9756841074b7c8905dfc791d0d944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:48.614445 23625 tablet_bootstrap.cc:654] T 46e9756841074b7c8905dfc791d0d944 P 02d99578b85244d48a79b842e6dec67b: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:48.615602 23624 tablet_bootstrap.cc:492] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09: Bootstrap starting.
I20260808 15:56:48.616412 23622 tablet_bootstrap.cc:492] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7: Bootstrap starting.
I20260808 15:56:48.616509 23624 tablet_bootstrap.cc:654] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:48.617555 23625 tablet_bootstrap.cc:492] T 46e9756841074b7c8905dfc791d0d944 P 02d99578b85244d48a79b842e6dec67b: No bootstrap required, opened a new log
I20260808 15:56:48.617652 23625 ts_tablet_manager.cc:1397] T 46e9756841074b7c8905dfc791d0d944 P 02d99578b85244d48a79b842e6dec67b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 15:56:48.618089 23625 raft_consensus.cc:348] T 46e9756841074b7c8905dfc791d0d944 P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.618211 23625 raft_consensus.cc:374] T 46e9756841074b7c8905dfc791d0d944 P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:48.618248 23625 raft_consensus.cc:729] T 46e9756841074b7c8905dfc791d0d944 P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02d99578b85244d48a79b842e6dec67b, State: Initialized, Role: FOLLOWER
I20260808 15:56:48.618389 23625 consensus_queue.cc:260] T 46e9756841074b7c8905dfc791d0d944 P 02d99578b85244d48a79b842e6dec67b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.618932 23625 ts_tablet_manager.cc:1428] T 46e9756841074b7c8905dfc791d0d944 P 02d99578b85244d48a79b842e6dec67b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:56:48.619422 23622 tablet_bootstrap.cc:654] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:48.619834 23624 tablet_bootstrap.cc:492] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09: No bootstrap required, opened a new log
I20260808 15:56:48.619925 23624 ts_tablet_manager.cc:1397] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260808 15:56:48.620391 23624 raft_consensus.cc:348] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.620505 23624 raft_consensus.cc:374] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:48.620541 23624 raft_consensus.cc:729] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c3042c73a48451fa0de621122878e09, State: Initialized, Role: FOLLOWER
I20260808 15:56:48.620668 23624 consensus_queue.cc:260] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.621007 23624 ts_tablet_manager.cc:1428] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:56:48.622033 23622 tablet_bootstrap.cc:492] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7: No bootstrap required, opened a new log
I20260808 15:56:48.622117 23622 ts_tablet_manager.cc:1397] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260808 15:56:48.622525 23622 raft_consensus.cc:348] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.622633 23622 raft_consensus.cc:374] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:48.622663 23622 raft_consensus.cc:729] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f7e50e6f9c544169e3a1bc4e309acc7, State: Initialized, Role: FOLLOWER
I20260808 15:56:48.622784 23622 consensus_queue.cc:260] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.623030 23622 ts_tablet_manager.cc:1428] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 15:56:48.728615 23635 raft_consensus.cc:482] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:56:48.728778 23635 raft_consensus.cc:504] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.729264 23635 leader_election.cc:288] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02d99578b85244d48a79b842e6dec67b (127.19.93.1:45283), 8f7e50e6f9c544169e3a1bc4e309acc7 (127.19.93.2:40337)
I20260808 15:56:48.729682 22843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e9756841074b7c8905dfc791d0d944" candidate_uuid: "6c3042c73a48451fa0de621122878e09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d99578b85244d48a79b842e6dec67b" is_pre_election: true
I20260808 15:56:48.729763 23089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e9756841074b7c8905dfc791d0d944" candidate_uuid: "6c3042c73a48451fa0de621122878e09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" is_pre_election: true
I20260808 15:56:48.729837 22843 raft_consensus.cc:2454] T 46e9756841074b7c8905dfc791d0d944 P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c3042c73a48451fa0de621122878e09 in term 0.
I20260808 15:56:48.729918 23089 raft_consensus.cc:2454] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c3042c73a48451fa0de621122878e09 in term 0.
I20260808 15:56:48.730307 23222 leader_election.cc:302] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 02d99578b85244d48a79b842e6dec67b, 6c3042c73a48451fa0de621122878e09, 8f7e50e6f9c544169e3a1bc4e309acc7; no voters:
I20260808 15:56:48.730602 23635 raft_consensus.cc:2781] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:56:48.730664 23635 raft_consensus.cc:482] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:56:48.730700 23635 raft_consensus.cc:3037] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:48.732015 23635 raft_consensus.cc:504] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.732440 23635 leader_election.cc:288] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [CANDIDATE]: Term 1 election: Requested vote from peers 02d99578b85244d48a79b842e6dec67b (127.19.93.1:45283), 8f7e50e6f9c544169e3a1bc4e309acc7 (127.19.93.2:40337)
I20260808 15:56:48.732818 22843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e9756841074b7c8905dfc791d0d944" candidate_uuid: "6c3042c73a48451fa0de621122878e09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d99578b85244d48a79b842e6dec67b"
I20260808 15:56:48.732853 23089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e9756841074b7c8905dfc791d0d944" candidate_uuid: "6c3042c73a48451fa0de621122878e09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7"
I20260808 15:56:48.732924 22843 raft_consensus.cc:3037] T 46e9756841074b7c8905dfc791d0d944 P 02d99578b85244d48a79b842e6dec67b [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:48.732964 23089 raft_consensus.cc:3037] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:48.734066 22843 raft_consensus.cc:2454] T 46e9756841074b7c8905dfc791d0d944 P 02d99578b85244d48a79b842e6dec67b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c3042c73a48451fa0de621122878e09 in term 1.
I20260808 15:56:48.734086 23089 raft_consensus.cc:2454] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c3042c73a48451fa0de621122878e09 in term 1.
I20260808 15:56:48.734396 23222 leader_election.cc:302] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c3042c73a48451fa0de621122878e09, 8f7e50e6f9c544169e3a1bc4e309acc7; no voters:
I20260808 15:56:48.734563 23635 raft_consensus.cc:2781] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:48.734720 23635 raft_consensus.cc:686] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [term 1 LEADER]: Becoming Leader. State: Replica: 6c3042c73a48451fa0de621122878e09, State: Running, Role: LEADER
I20260808 15:56:48.734860 23635 consensus_queue.cc:237] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } }
I20260808 15:56:48.736913 22570 catalog_manager.cc:5495] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c3042c73a48451fa0de621122878e09 (127.19.93.3). New cstate: current_term: 1 leader_uuid: "6c3042c73a48451fa0de621122878e09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c3042c73a48451fa0de621122878e09" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42947 } health_report { overall_health: HEALTHY } } }
I20260808 15:56:48.754714 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:48.751227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40738 (local address 127.19.93.3:42947)
0808 15:56:48.751493 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:48.751503 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:48.751518 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:56:48.751563 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:48.751566 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:48.751615 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:48.751699 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:56:48.751891 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:48.752752 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:48.753528 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:48.753914 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:48.754014 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:48.754276 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:56:48.754364 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:56:48.754433 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:48.754508 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 15:56:48.754561 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":97,"threads_started":1}
I20260808 15:56:48.761487 23089 raft_consensus.cc:1261] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Refusing update from remote peer 6c3042c73a48451fa0de621122878e09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:56:48.761502 22843 raft_consensus.cc:1261] T 46e9756841074b7c8905dfc791d0d944 P 02d99578b85244d48a79b842e6dec67b [term 1 FOLLOWER]: Refusing update from remote peer 6c3042c73a48451fa0de621122878e09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:56:48.761920 23655 consensus_queue.cc:1035] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d99578b85244d48a79b842e6dec67b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 45283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:56:48.762094 23635 consensus_queue.cc:1035] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f7e50e6f9c544169e3a1bc4e309acc7" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 15:56:48.776427 23582 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 15:56:50.328181 22570 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:56:50.328325 22570 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:56:50.330621 22570 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dfbac108bfda4eb584ed721233359d55: Sending DeleteTablet for 3 replicas of tablet 46e9756841074b7c8905dfc791d0d944
I20260808 15:56:50.331089 22798 tablet_service.cc:1514] Processing DeleteTablet for tablet 46e9756841074b7c8905dfc791d0d944 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:50 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:49906
I20260808 15:56:50.331187 23304 tablet_service.cc:1514] Processing DeleteTablet for tablet 46e9756841074b7c8905dfc791d0d944 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:50 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:40726
I20260808 15:56:50.331374 23055 tablet_service.cc:1514] Processing DeleteTablet for tablet 46e9756841074b7c8905dfc791d0d944 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:56:50 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:36294
I20260808 15:56:50.331516 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 22693
I20260808 15:56:50.331553 23715 tablet_replica.cc:330] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09: stopping tablet replica
I20260808 15:56:50.331719 23715 raft_consensus.cc:2229] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:56:50.331871 23715 raft_consensus.cc:2258] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:50.332422 23715 ts_tablet_manager.cc:1905] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:50.334546 23715 ts_tablet_manager.cc:1918] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 15:56:50.334635 23715 log.cc:1196] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/46e9756841074b7c8905dfc791d0d944
I20260808 15:56:50.334862 23715 ts_tablet_manager.cc:1939] T 46e9756841074b7c8905dfc791d0d944 P 6c3042c73a48451fa0de621122878e09: Deleting consensus metadata
I20260808 15:56:50.345932 22550 catalog_manager.cc:4841] TS 6c3042c73a48451fa0de621122878e09 (127.19.93.3:42947): tablet 46e9756841074b7c8905dfc791d0d944 (table test-table [id=b492a2acd85741dbac1527bfb57e6565]) successfully deleted
I20260808 15:56:50.346299 23716 tablet_replica.cc:330] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7: stopping tablet replica
I20260808 15:56:50.346457 23716 raft_consensus.cc:2229] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:56:50.346588 23716 raft_consensus.cc:2258] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:56:50.347203 23716 ts_tablet_manager.cc:1905] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:56:50.349553 23716 ts_tablet_manager.cc:1918] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 15:56:50.349643 23716 log.cc:1196] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/46e9756841074b7c8905dfc791d0d944
I20260808 15:56:50.349903 23716 ts_tablet_manager.cc:1939] T 46e9756841074b7c8905dfc791d0d944 P 8f7e50e6f9c544169e3a1bc4e309acc7: Deleting consensus metadata
I20260808 15:56:50.350629 22552 catalog_manager.cc:4841] TS 8f7e50e6f9c544169e3a1bc4e309acc7 (127.19.93.2:40337): tablet 46e9756841074b7c8905dfc791d0d944 (table test-table [id=b492a2acd85741dbac1527bfb57e6565]) successfully deleted
W20260808 15:56:50.352715 22554 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:45283 (error 108)
I20260808 15:56:50.352933 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 22923
I20260808 15:56:50.361649 23721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:50.361107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:45283 (local address 127.0.0.1:43452)
0808 15:56:50.361393 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:50.361508 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:45283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":89,"threads_started":1}
W20260808 15:56:50.362287 22554 catalog_manager.cc:4584] TS 02d99578b85244d48a79b842e6dec67b (127.19.93.1:45283): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 46e9756841074b7c8905dfc791d0d944: Network error: Client connection negotiation failed: client connection to 127.19.93.1:45283: connect: Connection refused (error 111)
I20260808 15:56:50.368870 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 23190
I20260808 15:56:50.380929 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 22523
2026-08-08T15:56:50Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6462 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:56:50 dist-test-slave-lgr5 krb5kdc[23724](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:56:50 dist-test-slave-lgr5 krb5kdc[23724](info): set up 2 sockets
Aug 08 15:56:50 dist-test-slave-lgr5 krb5kdc[23724](info): commencing operation
krb5kdc: starting...
W20260808 15:56:51.538276 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:56:51 dist-test-slave-lgr5 krb5kdc[23724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204611, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:56:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:56:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:56:51.648104 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:39737
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:36597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:39737
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:51.755283 23747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:51.755518 23747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:51.755558 23747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:51.759495 23747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:56:51.759549 23747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:51.759570 23747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:51.759600 23747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:56:51.759626 23747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:56:51.764771 23747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:39737
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:39737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:51.765702 23747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:51.766655 23747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:51.774641 23758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:51.774746 23761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:51.774824 23747 server_base.cc:1034] running on GCE node
W20260808 15:56:51.774667 23763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:51.775414 23747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:51.776443 23747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:51.777608 23747 hybrid_clock.cc:648] HybridClock initialized: now 1786204611777593 us; error 26 us; skew 500 ppm
Aug 08 15:56:51 dist-test-slave-lgr5 krb5kdc[23724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204611, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:51.780126 23747 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:56:51.780890 23747 webserver.cc:460] Webserver started at http://127.19.93.62:35237/ using document root <none> and password file <none>
I20260808 15:56:51.781384 23747 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:51.781448 23747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:51.781628 23747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:51.783501 23747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "d0389eb6f4e34e4998467443fede6036"
format_stamp: "Formatted at 2026-08-08 15:56:51 on dist-test-slave-lgr5"
server_key: "a1731a7364efdf92f1753b9e8511c1a3"
server_key_iv: "152a1a052c1879fbf271997a51501e26"
server_key_version: "encryptionkey@0"
I20260808 15:56:51.784022 23747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "d0389eb6f4e34e4998467443fede6036"
format_stamp: "Formatted at 2026-08-08 15:56:51 on dist-test-slave-lgr5"
server_key: "a1731a7364efdf92f1753b9e8511c1a3"
server_key_iv: "152a1a052c1879fbf271997a51501e26"
server_key_version: "encryptionkey@0"
I20260808 15:56:51.787417 23747 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:56:51.789745 23776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:51.790825 23747 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:56:51.790943 23747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "d0389eb6f4e34e4998467443fede6036"
format_stamp: "Formatted at 2026-08-08 15:56:51 on dist-test-slave-lgr5"
server_key: "a1731a7364efdf92f1753b9e8511c1a3"
server_key_iv: "152a1a052c1879fbf271997a51501e26"
server_key_version: "encryptionkey@0"
I20260808 15:56:51.791039 23747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:51.800180 23747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:51.802655 23747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:51.802834 23747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:51.809679 23747 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:39737
I20260808 15:56:51.809700 23866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:39737 every 8 connection(s)
I20260808 15:56:51.810599 23747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:56:51.813042 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 23747
I20260808 15:56:51.813163 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:56:51.813445 19828 external_mini_cluster.cc:1428] Setting key 8b5930594ec5f5b8db5f11b4af3beb89
I20260808 15:56:51.813452 23868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:51.820120 23868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036: Bootstrap starting.
Aug 08 15:56:51 dist-test-slave-lgr5 krb5kdc[23724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204611, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:51.822609 23868 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:51.823415 23868 log.cc:824] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036: Log is configured to *not* fsync() on all Append() calls
I20260808 15:56:51.825516 23868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036: No bootstrap required, opened a new log
I20260808 15:56:51.827944 23871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:51.814778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59176 (local address 127.19.93.62:39737)
0808 15:56:51.815200 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:51.815215 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:51.815253 (+ 38us) server_negotiation.cc:407] Connection header received
0808 15:56:51.816040 (+ 787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:51.816059 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:51.816408 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:51.816677 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:51.817539 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:51.818534 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:51.819699 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:51.820236 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:51.820382 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:51.823010 (+ 2628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:51.823017 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:51.823031 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:51.823062 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:51.824998 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:51.825418 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:51.825423 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:51.825429 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:51.825581 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:51.825874 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:51.825877 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:51.825879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:51.826352 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:51.826524 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:51.826740 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 15:56:51.827014 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":119,"threads_started":1}
I20260808 15:56:51.829720 23868 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0389eb6f4e34e4998467443fede6036" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39737 } }
I20260808 15:56:51.829970 23868 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:51.830083 23868 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0389eb6f4e34e4998467443fede6036, State: Initialized, Role: FOLLOWER
I20260808 15:56:51.830478 23868 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0389eb6f4e34e4998467443fede6036" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39737 } }
I20260808 15:56:51.830605 23868 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:56:51.830667 23868 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:56:51.830757 23868 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:51.831537 23868 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0389eb6f4e34e4998467443fede6036" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39737 } }
I20260808 15:56:51.831861 23868 leader_election.cc:302] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0389eb6f4e34e4998467443fede6036; no voters:
I20260808 15:56:51.832175 23868 leader_election.cc:288] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:56:51.832263 23875 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:51.832454 23875 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [term 1 LEADER]: Becoming Leader. State: Replica: d0389eb6f4e34e4998467443fede6036, State: Running, Role: LEADER
I20260808 15:56:51.832803 23875 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0389eb6f4e34e4998467443fede6036" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39737 } }
I20260808 15:56:51.833268 23868 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:56:51.834416 23876 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0389eb6f4e34e4998467443fede6036" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0389eb6f4e34e4998467443fede6036" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39737 } } }
I20260808 15:56:51.834527 23876 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [sys.catalog]: This master's current role is: LEADER
I20260808 15:56:51.834394 23878 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0389eb6f4e34e4998467443fede6036. Latest consensus state: current_term: 1 leader_uuid: "d0389eb6f4e34e4998467443fede6036" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0389eb6f4e34e4998467443fede6036" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39737 } } }
I20260808 15:56:51.834602 23878 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036 [sys.catalog]: This master's current role is: LEADER
I20260808 15:56:51.834934 23890 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:56:51.837482 23890 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:56:51.842954 23890 catalog_manager.cc:1347] Generated new cluster ID: c15e50abf022433aac6ea92e9d103c04
I20260808 15:56:51.843046 23890 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:56:51.864328 23890 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:56:51.865149 23890 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:56:51.870644 23890 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0389eb6f4e34e4998467443fede6036: Generated new TSK 0
I20260808 15:56:51.871204 23890 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 15:56:51.904281 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39737
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:36597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:52.014087 23912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:52.014325 23912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:52.014385 23912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:52.018312 23912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:52.018363 23912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:52.018436 23912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:56:52.023478 23912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:52.024463 23912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:52.025420 23912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:52.034463 23922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:52.034480 23926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:52.034480 23921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:52.034655 23912 server_base.cc:1034] running on GCE node
I20260808 15:56:52.035116 23912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:52.035746 23912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:52.036917 23912 hybrid_clock.cc:648] HybridClock initialized: now 1786204612036887 us; error 37 us; skew 500 ppm
Aug 08 15:56:52 dist-test-slave-lgr5 krb5kdc[23724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204612, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:52.039669 23912 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:56:52.040495 23912 webserver.cc:460] Webserver started at http://127.19.93.1:40331/ using document root <none> and password file <none>
I20260808 15:56:52.040980 23912 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:52.041044 23912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:52.041206 23912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:52.043143 23912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "799e28620c5c4006a21b372f1c56f288"
format_stamp: "Formatted at 2026-08-08 15:56:52 on dist-test-slave-lgr5"
server_key: "7f8c78e158e3a0b1a62cc6999eff14ef"
server_key_iv: "6c7c2694327dfc1ae0459e8887b1ed54"
server_key_version: "encryptionkey@0"
I20260808 15:56:52.043625 23912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "799e28620c5c4006a21b372f1c56f288"
format_stamp: "Formatted at 2026-08-08 15:56:52 on dist-test-slave-lgr5"
server_key: "7f8c78e158e3a0b1a62cc6999eff14ef"
server_key_iv: "6c7c2694327dfc1ae0459e8887b1ed54"
server_key_version: "encryptionkey@0"
I20260808 15:56:52.046983 23912 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 15:56:52.049163 23937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:52.050253 23912 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:56:52.050349 23912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "799e28620c5c4006a21b372f1c56f288"
format_stamp: "Formatted at 2026-08-08 15:56:52 on dist-test-slave-lgr5"
server_key: "7f8c78e158e3a0b1a62cc6999eff14ef"
server_key_iv: "6c7c2694327dfc1ae0459e8887b1ed54"
server_key_version: "encryptionkey@0"
I20260808 15:56:52.050441 23912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:52.076933 23912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:52.079481 23912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:52.079643 23912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:52.080224 23912 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:56:52.080983 23912 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:52.081036 23912 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:52.081081 23912 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:52.081110 23912 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:52.089411 23912 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:43525
I20260808 15:56:52.089445 24122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:43525 every 8 connection(s)
I20260808 15:56:52.090230 23912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:56:52.090456 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 23912
I20260808 15:56:52.090553 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:56:52.090844 19828 external_mini_cluster.cc:1428] Setting key 55a652cb72c98a9b8c06ecb3b4d53ec5
Aug 08 15:56:52 dist-test-slave-lgr5 krb5kdc[23724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204612, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
I20260808 15:56:52.103900 23871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:52.092047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:35867 (local address 127.19.93.62:39737)
0808 15:56:52.092193 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:52.092197 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:52.093107 (+ 910us) server_negotiation.cc:407] Connection header received
0808 15:56:52.094632 (+ 1525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:52.094635 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:52.094688 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:52.094758 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:52.095905 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:52.096497 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:52.097657 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:52.097882 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:52.097973 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:52.100534 (+ 2561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:52.100539 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:52.100542 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:52.100568 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:52.101904 (+ 1336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:52.102411 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:52.102414 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:52.102416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:52.102521 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:52.102793 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:52.102795 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:52.102796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:52.103002 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:52.103084 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:52.103604 (+ 520us) server_negotiation.cc:299] Negotiation successful
0808 15:56:52.103728 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 15:56:52.104586 24126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:52.092468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:39737 (local address 127.19.93.1:35867)
0808 15:56:52.092946 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:52.092998 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:52.094433 (+ 1435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:52.094939 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:52.094947 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:52.095309 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:52.095767 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:52.095781 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:52.096616 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:52.096619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:52.097538 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:52.097549 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:52.098015 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:52.098019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:52.098185 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:52.098683 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:52.098699 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:52.100364 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:52.102018 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:52.102022 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:52.102034 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:52.102267 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:52.102589 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:52.102591 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:52.102592 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:52.102708 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:52.103104 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:52.103110 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:52.103371 (+ 261us) client_negotiation.cc:769] Sending connection context
0808 15:56:52.103523 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 15:56:52.103767 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":98,"threads_started":1}
I20260808 15:56:52.105690 24123 heartbeater.cc:347] Connected to a master server at 127.19.93.62:39737
I20260808 15:56:52.105913 24123 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:52.106344 24123 heartbeater.cc:511] Master 127.19.93.62:39737 requested a full tablet report, sending...
I20260808 15:56:52.107784 23808 ts_manager.cc:194] Registered new tserver with Master: 799e28620c5c4006a21b372f1c56f288 (127.19.93.1:43525)
I20260808 15:56:52.108889 23808 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:35867
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 15:56:52.118105 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39737
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:36597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:52.227578 24135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:52.227828 24135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:52.227885 24135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:52.231794 24135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:52.231848 24135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:52.231923 24135 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:56:52.237120 24135 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24135
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:52.238060 24135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:52.239012 24135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:52.248140 24143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:52.248111 24144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:52.248133 24146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:52.248167 24135 server_base.cc:1034] running on GCE node
I20260808 15:56:52.248733 24135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:52.249295 24135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:52.250453 24135 hybrid_clock.cc:648] HybridClock initialized: now 1786204612250434 us; error 31 us; skew 500 ppm
Aug 08 15:56:52 dist-test-slave-lgr5 krb5kdc[23724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204612, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:52.253027 24135 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:56:52.253822 24135 webserver.cc:460] Webserver started at http://127.19.93.2:41715/ using document root <none> and password file <none>
I20260808 15:56:52.254354 24135 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:52.254412 24135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:52.254587 24135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:52.256518 24135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "41c10b8fded547968f873eb4a571bf58"
format_stamp: "Formatted at 2026-08-08 15:56:52 on dist-test-slave-lgr5"
server_key: "8fbe197827815aa0bd7428f337f37db9"
server_key_iv: "cae49267b3f80c83e4dd000b975f6c69"
server_key_version: "encryptionkey@0"
I20260808 15:56:52.257025 24135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "41c10b8fded547968f873eb4a571bf58"
format_stamp: "Formatted at 2026-08-08 15:56:52 on dist-test-slave-lgr5"
server_key: "8fbe197827815aa0bd7428f337f37db9"
server_key_iv: "cae49267b3f80c83e4dd000b975f6c69"
server_key_version: "encryptionkey@0"
I20260808 15:56:52.260367 24135 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:56:52.262557 24156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:52.263638 24135 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:56:52.263726 24135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "41c10b8fded547968f873eb4a571bf58"
format_stamp: "Formatted at 2026-08-08 15:56:52 on dist-test-slave-lgr5"
server_key: "8fbe197827815aa0bd7428f337f37db9"
server_key_iv: "cae49267b3f80c83e4dd000b975f6c69"
server_key_version: "encryptionkey@0"
I20260808 15:56:52.263803 24135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:52.292202 24135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:52.294951 24135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:52.295132 24135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:52.295729 24135 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:56:52.296586 24135 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:52.296633 24135 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:52.296676 24135 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:52.296705 24135 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:52.305346 24135 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:35111
I20260808 15:56:52.305370 24336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:35111 every 8 connection(s)
I20260808 15:56:52.306192 24135 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:56:52.313908 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 24135
I20260808 15:56:52.314024 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:56:52.314287 19828 external_mini_cluster.cc:1428] Setting key a59433520dab708a975e02d91dd95793
Aug 08 15:56:52 dist-test-slave-lgr5 krb5kdc[23724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204612, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:52.318902 23871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:52.307874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:58965 (local address 127.19.93.62:39737)
0808 15:56:52.308014 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:52.308019 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:52.308919 (+ 900us) server_negotiation.cc:407] Connection header received
0808 15:56:52.310119 (+ 1200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:52.310122 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:52.310170 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:52.310241 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:52.311391 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:52.311930 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:52.313051 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:52.313277 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:52.313382 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:52.315740 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:52.315744 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:52.315746 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:52.315767 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:52.317020 (+ 1253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:52.317506 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:52.317509 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:52.317510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:52.317582 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:52.317891 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:52.317894 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:52.317896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:52.318065 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:52.318148 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:52.318611 (+ 463us) server_negotiation.cc:299] Negotiation successful
0808 15:56:52.318736 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 15:56:52.319582 24339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:52.308312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:39737 (local address 127.19.93.2:58965)
0808 15:56:52.308762 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:52.308803 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:52.309926 (+ 1123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:52.310431 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:52.310438 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:52.310753 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:52.311226 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:52.311240 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:52.312025 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:52.312028 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:52.312932 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:52.312943 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:52.313411 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:52.313414 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:52.313551 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:52.314091 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:52.314107 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:52.315594 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:52.317148 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:52.317153 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:52.317168 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:52.317415 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:52.317662 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:52.317665 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:52.317667 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:52.317801 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:52.318162 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:52.318169 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:52.318397 (+ 228us) client_negotiation.cc:769] Sending connection context
0808 15:56:52.318551 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 15:56:52.318839 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":115,"threads_started":1}
I20260808 15:56:52.320598 24337 heartbeater.cc:347] Connected to a master server at 127.19.93.62:39737
I20260808 15:56:52.320809 24337 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:52.321249 24337 heartbeater.cc:511] Master 127.19.93.62:39737 requested a full tablet report, sending...
I20260808 15:56:52.322238 23808 ts_manager.cc:194] Registered new tserver with Master: 41c10b8fded547968f873eb4a571bf58 (127.19.93.2:35111)
I20260808 15:56:52.322994 23808 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:58965
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 15:56:52.339113 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39737
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:36597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:52.447803 24343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:52.448036 24343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:52.448123 24343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:52.451956 24343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:52.452014 24343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:52.452131 24343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:56:52.457229 24343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:52.458140 24343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:52.459213 24343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:52.468456 24354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:52.468520 24351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:52.468469 24350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:52.468592 24343 server_base.cc:1034] running on GCE node
I20260808 15:56:52.469120 24343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:52.469707 24343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:52.470885 24343 hybrid_clock.cc:648] HybridClock initialized: now 1786204612470868 us; error 25 us; skew 500 ppm
Aug 08 15:56:52 dist-test-slave-lgr5 krb5kdc[23724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204612, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:52.473551 24343 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:56:52.474357 24343 webserver.cc:460] Webserver started at http://127.19.93.3:38921/ using document root <none> and password file <none>
I20260808 15:56:52.474853 24343 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:52.474910 24343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:52.475080 24343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:52.477079 24343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "1b0291064b6c4849a81b08663cd52e68"
format_stamp: "Formatted at 2026-08-08 15:56:52 on dist-test-slave-lgr5"
server_key: "ab763ae4ff64711b2eeb9e24888e471d"
server_key_iv: "2723abd5bb5d0d0bf86e9fe49e3720b0"
server_key_version: "encryptionkey@0"
I20260808 15:56:52.477576 24343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "1b0291064b6c4849a81b08663cd52e68"
format_stamp: "Formatted at 2026-08-08 15:56:52 on dist-test-slave-lgr5"
server_key: "ab763ae4ff64711b2eeb9e24888e471d"
server_key_iv: "2723abd5bb5d0d0bf86e9fe49e3720b0"
server_key_version: "encryptionkey@0"
I20260808 15:56:52.480976 24343 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:56:52.483197 24364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:52.484318 24343 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:56:52.484442 24343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "1b0291064b6c4849a81b08663cd52e68"
format_stamp: "Formatted at 2026-08-08 15:56:52 on dist-test-slave-lgr5"
server_key: "ab763ae4ff64711b2eeb9e24888e471d"
server_key_iv: "2723abd5bb5d0d0bf86e9fe49e3720b0"
server_key_version: "encryptionkey@0"
I20260808 15:56:52.484534 24343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:52.493593 24343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:52.496443 24343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:52.496580 24343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:52.497054 24343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:56:52.497814 24343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:52.497859 24343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:52.497895 24343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:52.497915 24343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:52.505800 24343 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:37889
I20260808 15:56:52.505858 24543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:37889 every 8 connection(s)
I20260808 15:56:52.506613 24343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:56:52.514633 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 24343
I20260808 15:56:52.514755 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:56:52.515066 19828 external_mini_cluster.cc:1428] Setting key 815c10ced54e5b3104c1b40ea2a46d37
Aug 08 15:56:52 dist-test-slave-lgr5 krb5kdc[23724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204612, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:52.519814 23871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:52.508280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:34323 (local address 127.19.93.62:39737)
0808 15:56:52.508405 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:52.508408 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:52.509175 (+ 767us) server_negotiation.cc:407] Connection header received
0808 15:56:52.510598 (+ 1423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:52.510602 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:52.510663 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:52.510743 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:52.512283 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:52.512887 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:52.513997 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:52.514229 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:52.514305 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:52.516902 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:52.516905 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:52.516908 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:52.516935 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:52.518246 (+ 1311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:52.518670 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:52.518672 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:52.518673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:52.518739 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:52.518993 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:52.518994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:52.518995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:52.519162 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:52.519237 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:52.519613 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 15:56:52.519701 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 15:56:52.520594 24547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:52.508607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:39737 (local address 127.19.93.3:34323)
0808 15:56:52.509037 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:52.509080 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:52.510396 (+ 1316us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:52.510969 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:52.510978 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:52.511434 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:52.512098 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:52.512121 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:52.513011 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:52.513014 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:52.513891 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:52.513902 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:52.514342 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:52.514345 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:52.514531 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:52.515096 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:52.515116 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:52.516752 (+ 1636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:52.518343 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:52.518347 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:52.518360 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:52.518593 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:52.518796 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:52.518798 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:52.518800 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:52.518927 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:52.519229 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:52.519233 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:52.519437 (+ 204us) client_negotiation.cc:769] Sending connection context
0808 15:56:52.519571 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 15:56:52.519790 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":137,"threads_started":1}
I20260808 15:56:52.521584 24544 heartbeater.cc:347] Connected to a master server at 127.19.93.62:39737
I20260808 15:56:52.521786 24544 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:52.522222 24544 heartbeater.cc:511] Master 127.19.93.62:39737 requested a full tablet report, sending...
I20260808 15:56:52.523164 23808 ts_manager.cc:194] Registered new tserver with Master: 1b0291064b6c4849a81b08663cd52e68 (127.19.93.3:37889)
I20260808 15:56:52.523684 23808 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:34323
I20260808 15:56:52.528713 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 15:56:52.542799 23871 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:56:52.541613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59188 (local address 127.19.93.62:39737)
0808 15:56:52.541727 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:52.541730 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:52.541900 (+ 170us) server_negotiation.cc:407] Connection header received
0808 15:56:52.541969 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:52.541971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:52.542018 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:52.542086 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:52.542671 (+ 585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59188: BlockingRecv error: recv got EOF from 127.0.0.1:59188 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:56:52.544508 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 23912
I20260808 15:56:52.566897 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 24135
I20260808 15:56:52.577518 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 24343
I20260808 15:56:52.590399 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 23747
2026-08-08T15:56:52Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2204 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:56:52 dist-test-slave-lgr5 krb5kdc[24565](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:56:52 dist-test-slave-lgr5 krb5kdc[24565](info): set up 2 sockets
Aug 08 15:56:52 dist-test-slave-lgr5 krb5kdc[24565](info): commencing operation
krb5kdc: starting...
W20260808 15:56:53.740466 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:56:53 dist-test-slave-lgr5 krb5kdc[24565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:56:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:56:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:56:53.850857 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:39277
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:35513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:39277
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:53.956449 24583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:53.956674 24583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:53.956710 24583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:53.960533 24583 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:56:53.960577 24583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:53.960595 24583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:53.960610 24583 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:56:53.960629 24583 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:56:53.965569 24583 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:35513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:39277
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:39277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:53.966411 24583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:53.967275 24583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:53.976019 24588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:53.976070 24595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:53.976030 24592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:53.977495 24583 server_base.cc:1034] running on GCE node
I20260808 15:56:53.977990 24583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:53.978977 24583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:53.980155 24583 hybrid_clock.cc:648] HybridClock initialized: now 1786204613980139 us; error 24 us; skew 500 ppm
Aug 08 15:56:53 dist-test-slave-lgr5 krb5kdc[24565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204613, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:53.982755 24583 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:56:53.983522 24583 webserver.cc:460] Webserver started at http://127.19.93.62:42413/ using document root <none> and password file <none>
I20260808 15:56:53.983994 24583 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:53.984047 24583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:53.984251 24583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:53.986150 24583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "3defe1a996964d8c8da0de770413b469"
format_stamp: "Formatted at 2026-08-08 15:56:53 on dist-test-slave-lgr5"
server_key: "11f2617c10caf716260966c4fc25c827"
server_key_iv: "731a755cdeea2b1c73c65936a9c81023"
server_key_version: "encryptionkey@0"
I20260808 15:56:53.986649 24583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "3defe1a996964d8c8da0de770413b469"
format_stamp: "Formatted at 2026-08-08 15:56:53 on dist-test-slave-lgr5"
server_key: "11f2617c10caf716260966c4fc25c827"
server_key_iv: "731a755cdeea2b1c73c65936a9c81023"
server_key_version: "encryptionkey@0"
I20260808 15:56:53.990047 24583 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:56:53.992239 24604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:53.993366 24583 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:56:53.993474 24583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "3defe1a996964d8c8da0de770413b469"
format_stamp: "Formatted at 2026-08-08 15:56:53 on dist-test-slave-lgr5"
server_key: "11f2617c10caf716260966c4fc25c827"
server_key_iv: "731a755cdeea2b1c73c65936a9c81023"
server_key_version: "encryptionkey@0"
I20260808 15:56:53.993569 24583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:54.012584 24583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:54.015144 24583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:54.015298 24583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:54.021754 24583 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:39277
I20260808 15:56:54.021996 24689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:39277 every 8 connection(s)
I20260808 15:56:54.022634 24583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:56:54.025249 24692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:54.025897 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 24583
I20260808 15:56:54.025987 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:56:54.026232 19828 external_mini_cluster.cc:1428] Setting key 3bd84b563ae0dd3c0c234ceed60fe20d
I20260808 15:56:54.030987 24692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469: Bootstrap starting.
I20260808 15:56:54.033489 24692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:54.034330 24692 log.cc:824] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469: Log is configured to *not* fsync() on all Append() calls
Aug 08 15:56:54 dist-test-slave-lgr5 krb5kdc[24565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:54.036443 24692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469: No bootstrap required, opened a new log
I20260808 15:56:54.040002 24699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:54.027369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43690 (local address 127.19.93.62:39277)
0808 15:56:54.027755 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:54.027768 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:54.027800 (+ 32us) server_negotiation.cc:407] Connection header received
0808 15:56:54.028456 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:54.028475 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:54.028768 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:54.029032 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:54.029917 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:54.030825 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:54.031964 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:54.032477 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:54.032599 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:54.035235 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:54.035241 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:54.035256 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:54.035284 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:54.037134 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:54.037606 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:54.037612 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:54.037618 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:54.037752 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:54.037967 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:54.037970 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:54.037971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:54.038471 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:54.038667 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:54.038841 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 15:56:54.039119 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":104,"threads_started":1}
I20260808 15:56:54.040680 24692 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3defe1a996964d8c8da0de770413b469" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39277 } }
I20260808 15:56:54.040939 24692 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:54.041002 24692 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3defe1a996964d8c8da0de770413b469, State: Initialized, Role: FOLLOWER
I20260808 15:56:54.041424 24692 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3defe1a996964d8c8da0de770413b469" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39277 } }
I20260808 15:56:54.041543 24692 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:56:54.041628 24692 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:56:54.041733 24692 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:54.042707 24692 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3defe1a996964d8c8da0de770413b469" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39277 } }
I20260808 15:56:54.042789 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:56:54.043064 24692 leader_election.cc:302] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3defe1a996964d8c8da0de770413b469; no voters:
I20260808 15:56:54.043366 24692 leader_election.cc:288] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:56:54.043444 24701 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:54.043637 24701 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [term 1 LEADER]: Becoming Leader. State: Replica: 3defe1a996964d8c8da0de770413b469, State: Running, Role: LEADER
I20260808 15:56:54.043970 24701 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3defe1a996964d8c8da0de770413b469" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39277 } }
I20260808 15:56:54.044567 24692 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:56:54.045423 24705 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3defe1a996964d8c8da0de770413b469. Latest consensus state: current_term: 1 leader_uuid: "3defe1a996964d8c8da0de770413b469" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3defe1a996964d8c8da0de770413b469" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39277 } } }
I20260808 15:56:54.045539 24705 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [sys.catalog]: This master's current role is: LEADER
I20260808 15:56:54.045857 24703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3defe1a996964d8c8da0de770413b469" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3defe1a996964d8c8da0de770413b469" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39277 } } }
I20260808 15:56:54.045933 24703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469 [sys.catalog]: This master's current role is: LEADER
W20260808 15:56:54.049294 24729 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:56:54.049358 24729 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:56:54.049422 24717 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:56:54.050285 24717 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:56:54.057700 24717 catalog_manager.cc:1347] Generated new cluster ID: 81a88521b6844c41974d8c658bf06f30
I20260808 15:56:54.057758 24717 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:56:54.061836 24699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:54.056626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43706 (local address 127.19.93.62:39277)
0808 15:56:54.056731 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:54.056735 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:54.056962 (+ 227us) server_negotiation.cc:407] Connection header received
0808 15:56:54.057080 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:54.057083 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:54.057125 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:54.057188 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:54.057701 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:54.058450 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:54.059577 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:54.059947 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:54.060064 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:54.060933 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:54.060937 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:54.060940 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:56:54.061439 (+ 499us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:54.061472 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:56:54.061493 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:54.061585 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:54.061646 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 15:56:54.061705 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 15:56:54.094521 24717 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:56:54.095762 24717 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:56:54.103562 24717 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3defe1a996964d8c8da0de770413b469: Generated new TSK 0
I20260808 15:56:54.104213 24717 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:56:54.116485 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 24583
2026-08-08T15:56:54Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1529 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:56:54 dist-test-slave-lgr5 krb5kdc[24746](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:56:54 dist-test-slave-lgr5 krb5kdc[24746](info): set up 2 sockets
Aug 08 15:56:54 dist-test-slave-lgr5 krb5kdc[24746](info): commencing operation
krb5kdc: starting...
W20260808 15:56:55.278090 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:56:55 dist-test-slave-lgr5 krb5kdc[24746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:56:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:56:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:56:55.388662 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:42879
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:40233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:42879
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:55.495913 24765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:55.496205 24765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:55.496268 24765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:55.500223 24765 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:56:55.500283 24765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:55.500308 24765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:55.500329 24765 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:56:55.500349 24765 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:56:55.505470 24765 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:40233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:42879
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:42879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:55.506456 24765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:55.507436 24765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:55.515533 24775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:55.515673 24779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:55.515565 24774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:55.515678 24765 server_base.cc:1034] running on GCE node
I20260808 15:56:55.516469 24765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:55.517482 24765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:55.518644 24765 hybrid_clock.cc:648] HybridClock initialized: now 1786204615518623 us; error 30 us; skew 500 ppm
Aug 08 15:56:55 dist-test-slave-lgr5 krb5kdc[24746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204615, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:55.524482 24765 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:56:55.525311 24765 webserver.cc:460] Webserver started at http://127.19.93.62:40263/ using document root <none> and password file <none>
I20260808 15:56:55.525818 24765 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:55.525882 24765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:55.526065 24765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:55.527973 24765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "9978084b1ae34ea680f76d577ecedc25"
format_stamp: "Formatted at 2026-08-08 15:56:55 on dist-test-slave-lgr5"
server_key: "de80067125d9ae1ba65958f2892e1161"
server_key_iv: "f787cbea7b8747c5268399637ae893ec"
server_key_version: "encryptionkey@0"
I20260808 15:56:55.528554 24765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "9978084b1ae34ea680f76d577ecedc25"
format_stamp: "Formatted at 2026-08-08 15:56:55 on dist-test-slave-lgr5"
server_key: "de80067125d9ae1ba65958f2892e1161"
server_key_iv: "f787cbea7b8747c5268399637ae893ec"
server_key_version: "encryptionkey@0"
I20260808 15:56:55.531872 24765 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:56:55.534099 24789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:55.535195 24765 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 15:56:55.535303 24765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "9978084b1ae34ea680f76d577ecedc25"
format_stamp: "Formatted at 2026-08-08 15:56:55 on dist-test-slave-lgr5"
server_key: "de80067125d9ae1ba65958f2892e1161"
server_key_iv: "f787cbea7b8747c5268399637ae893ec"
server_key_version: "encryptionkey@0"
I20260808 15:56:55.535410 24765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:55.552045 24765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:55.554494 24765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:55.554651 24765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:55.561084 24765 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:42879
I20260808 15:56:55.561333 24872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:42879 every 8 connection(s)
I20260808 15:56:55.561928 24765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:56:55.563941 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 24765
I20260808 15:56:55.564047 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:56:55.564332 19828 external_mini_cluster.cc:1428] Setting key f4aa2c5b0ff384318c7372d8a3043b4b
I20260808 15:56:55.564563 24873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:55.571017 24873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25: Bootstrap starting.
Aug 08 15:56:55 dist-test-slave-lgr5 krb5kdc[24746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:55.573423 24873 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:55.574227 24873 log.cc:824] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25: Log is configured to *not* fsync() on all Append() calls
I20260808 15:56:55.576264 24873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25: No bootstrap required, opened a new log
I20260808 15:56:55.577597 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:55.565501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38072 (local address 127.19.93.62:42879)
0808 15:56:55.565868 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:55.565883 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:55.565916 (+ 33us) server_negotiation.cc:407] Connection header received
0808 15:56:55.566524 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:55.566539 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:55.566823 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:55.567067 (+ 244us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:55.567920 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:55.568918 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:55.570081 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:55.570524 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:55.570632 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:55.573172 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:55.573177 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:55.573189 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:55.573215 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:55.574934 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:55.575351 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:55.575357 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:55.575361 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:55.575476 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:55.575726 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:55.575730 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:55.575732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:55.576132 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:55.576303 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:55.576582 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 15:56:55.576955 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":108,"threads_started":1}
I20260808 15:56:55.580443 24873 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9978084b1ae34ea680f76d577ecedc25" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42879 } }
I20260808 15:56:55.580651 24873 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:55.580703 24873 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9978084b1ae34ea680f76d577ecedc25, State: Initialized, Role: FOLLOWER
I20260808 15:56:55.581084 24873 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9978084b1ae34ea680f76d577ecedc25" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42879 } }
I20260808 15:56:55.581202 24873 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:56:55.581261 24873 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:56:55.581355 24873 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:55.582139 24873 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9978084b1ae34ea680f76d577ecedc25" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42879 } }
I20260808 15:56:55.582445 24873 leader_election.cc:302] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9978084b1ae34ea680f76d577ecedc25; no voters:
I20260808 15:56:55.582698 24873 leader_election.cc:288] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:56:55.582806 24884 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:55.583046 24884 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [term 1 LEADER]: Becoming Leader. State: Replica: 9978084b1ae34ea680f76d577ecedc25, State: Running, Role: LEADER
I20260808 15:56:55.583346 24884 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9978084b1ae34ea680f76d577ecedc25" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42879 } }
I20260808 15:56:55.583783 24873 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:56:55.585013 24886 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9978084b1ae34ea680f76d577ecedc25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9978084b1ae34ea680f76d577ecedc25" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42879 } } }
I20260808 15:56:55.585011 24887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9978084b1ae34ea680f76d577ecedc25. Latest consensus state: current_term: 1 leader_uuid: "9978084b1ae34ea680f76d577ecedc25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9978084b1ae34ea680f76d577ecedc25" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42879 } } }
I20260808 15:56:55.585179 24886 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [sys.catalog]: This master's current role is: LEADER
I20260808 15:56:55.585179 24887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25 [sys.catalog]: This master's current role is: LEADER
I20260808 15:56:55.585598 24897 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:56:55.588454 24897 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:56:55.593254 24897 catalog_manager.cc:1347] Generated new cluster ID: 6a55eff5f5ee4756a043cd16883a8ade
I20260808 15:56:55.593322 24897 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:56:55.599995 24897 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:56:55.601197 24897 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:56:55.612038 24897 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9978084b1ae34ea680f76d577ecedc25: Generated new TSK 0
I20260808 15:56:55.612783 24897 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 15:56:55.638304 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42879
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:40233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:55.744619 24911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:55.744841 24911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:55.744879 24911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:55.748739 24911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:55.748790 24911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:55.748842 24911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:56:55.753862 24911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:40233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:55.754745 24911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:55.755653 24911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:55.764398 24917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:55.764410 24916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:55.764410 24921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:55.764572 24911 server_base.cc:1034] running on GCE node
I20260808 15:56:55.765090 24911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:55.765619 24911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:55.766781 24911 hybrid_clock.cc:648] HybridClock initialized: now 1786204615766760 us; error 31 us; skew 500 ppm
Aug 08 15:56:55 dist-test-slave-lgr5 krb5kdc[24746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204615, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:55.769340 24911 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:56:55.770112 24911 webserver.cc:460] Webserver started at http://127.19.93.1:39333/ using document root <none> and password file <none>
I20260808 15:56:55.770618 24911 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:55.770681 24911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:55.770856 24911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:55.772825 24911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "c33eeabcbf1b45319b7b6d07f8ccbb1b"
format_stamp: "Formatted at 2026-08-08 15:56:55 on dist-test-slave-lgr5"
server_key: "ffcd37cf92a4ff1fdc3660027bf9b820"
server_key_iv: "22f02865dcffba0a79c0309014da8e38"
server_key_version: "encryptionkey@0"
I20260808 15:56:55.773375 24911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "c33eeabcbf1b45319b7b6d07f8ccbb1b"
format_stamp: "Formatted at 2026-08-08 15:56:55 on dist-test-slave-lgr5"
server_key: "ffcd37cf92a4ff1fdc3660027bf9b820"
server_key_iv: "22f02865dcffba0a79c0309014da8e38"
server_key_version: "encryptionkey@0"
I20260808 15:56:55.776803 24911 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:56:55.778942 24928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:55.780061 24911 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:56:55.780186 24911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "c33eeabcbf1b45319b7b6d07f8ccbb1b"
format_stamp: "Formatted at 2026-08-08 15:56:55 on dist-test-slave-lgr5"
server_key: "ffcd37cf92a4ff1fdc3660027bf9b820"
server_key_iv: "22f02865dcffba0a79c0309014da8e38"
server_key_version: "encryptionkey@0"
I20260808 15:56:55.780277 24911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:55.800870 24911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:55.803501 24911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:55.803670 24911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:55.804288 24911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:56:55.805091 24911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:55.805145 24911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:55.805200 24911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:55.805228 24911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:55.813359 24911 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:42047
I20260808 15:56:55.813390 25119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:42047 every 8 connection(s)
I20260808 15:56:55.814204 24911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
Aug 08 15:56:55 dist-test-slave-lgr5 krb5kdc[24746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204615, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:55.823993 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 24911
I20260808 15:56:55.824149 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:56:55.824476 19828 external_mini_cluster.cc:1428] Setting key d5e71de5b88ed535f61c4a2851d3920a
I20260808 15:56:55.827049 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:55.815944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:40969 (local address 127.19.93.62:42879)
0808 15:56:55.816109 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:55.816114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:55.816832 (+ 718us) server_negotiation.cc:407] Connection header received
0808 15:56:55.818128 (+ 1296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:55.818131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:55.818188 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:55.818263 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:55.819367 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:55.819915 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:55.821090 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:55.821330 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:55.821430 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:55.823590 (+ 2160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:55.823593 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:55.823595 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:55.823619 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:55.825036 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:55.825567 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:55.825570 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:55.825571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:55.825654 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:55.826055 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:55.826059 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:55.826061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:55.826232 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:55.826317 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:55.826773 (+ 456us) server_negotiation.cc:299] Negotiation successful
0808 15:56:55.826895 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:56:55.827744 25122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:55.816288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42879 (local address 127.19.93.1:40969)
0808 15:56:55.816697 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:55.816736 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:55.817934 (+ 1198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:55.818443 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:55.818449 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:55.818775 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:55.819226 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:55.819239 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:55.820034 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:55.820036 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:55.820979 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:55.820989 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:55.821471 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:55.821475 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:55.821630 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:55.822122 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:55.822137 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:55.823432 (+ 1295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:55.825142 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:55.825148 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:55.825161 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:55.825465 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:55.825750 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:55.825753 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:55.825755 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:55.825944 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:55.826329 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:55.826335 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:55.826561 (+ 226us) client_negotiation.cc:769] Sending connection context
0808 15:56:55.826716 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 15:56:55.827017 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":106,"threads_started":1}
I20260808 15:56:55.828926 25120 heartbeater.cc:347] Connected to a master server at 127.19.93.62:42879
I20260808 15:56:55.829131 25120 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:55.829581 25120 heartbeater.cc:511] Master 127.19.93.62:42879 requested a full tablet report, sending...
I20260808 15:56:55.830973 24816 ts_manager.cc:194] Registered new tserver with Master: c33eeabcbf1b45319b7b6d07f8ccbb1b (127.19.93.1:42047)
I20260808 15:56:55.832050 24816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:40969
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 15:56:55.848480 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42879
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:40233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:55.955231 25125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:55.955461 25125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:55.955499 25125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:55.959324 25125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:55.959369 25125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:55.959422 25125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:56:55.964351 25125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:40233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:55.965241 25125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:55.966156 25125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:55.975376 25133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:55.982335 25134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:55.982569 25125 server_base.cc:1034] running on GCE node
W20260808 15:56:55.982792 25137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:55.983206 25125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:55.983893 25125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:55.985066 25125 hybrid_clock.cc:648] HybridClock initialized: now 1786204615985048 us; error 48 us; skew 500 ppm
Aug 08 15:56:55 dist-test-slave-lgr5 krb5kdc[24746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204615, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:55.987650 25125 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:56:55.988571 25125 webserver.cc:460] Webserver started at http://127.19.93.2:42877/ using document root <none> and password file <none>
I20260808 15:56:55.989074 25125 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:55.989130 25125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:55.989295 25125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:55.991216 25125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "98260779c6a645d59b3c459244678ded"
format_stamp: "Formatted at 2026-08-08 15:56:55 on dist-test-slave-lgr5"
server_key: "48efe273b58ff744dd92edfcab0095bf"
server_key_iv: "48feac32be78555aa63086f1173f9d7c"
server_key_version: "encryptionkey@0"
I20260808 15:56:55.991716 25125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "98260779c6a645d59b3c459244678ded"
format_stamp: "Formatted at 2026-08-08 15:56:55 on dist-test-slave-lgr5"
server_key: "48efe273b58ff744dd92edfcab0095bf"
server_key_iv: "48feac32be78555aa63086f1173f9d7c"
server_key_version: "encryptionkey@0"
I20260808 15:56:55.995225 25125 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 15:56:55.997567 25150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:55.998718 25125 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:56:55.998814 25125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "98260779c6a645d59b3c459244678ded"
format_stamp: "Formatted at 2026-08-08 15:56:55 on dist-test-slave-lgr5"
server_key: "48efe273b58ff744dd92edfcab0095bf"
server_key_iv: "48feac32be78555aa63086f1173f9d7c"
server_key_version: "encryptionkey@0"
I20260808 15:56:55.998917 25125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:56.007922 25125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:56.010846 25125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:56.011009 25125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:56.011564 25125 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:56:56.012400 25125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:56.012447 25125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:56.012490 25125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:56.012518 25125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:56.020888 25125 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:42953
I20260808 15:56:56.020924 25339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:42953 every 8 connection(s)
I20260808 15:56:56.021709 25125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:56:56.023999 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 25125
I20260808 15:56:56.024152 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:56:56.024483 19828 external_mini_cluster.cc:1428] Setting key 62c5c8599fa5dd6ef7b8c7d6812abf95
Aug 08 15:56:56 dist-test-slave-lgr5 krb5kdc[24746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204615, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
I20260808 15:56:56.034869 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:56.023303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:52525 (local address 127.19.93.62:42879)
0808 15:56:56.023422 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:56.023426 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:56.024282 (+ 856us) server_negotiation.cc:407] Connection header received
0808 15:56:56.025781 (+ 1499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:56.025784 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:56.025837 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:56.025919 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:56.027322 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:56.027862 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:56.029053 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:56.029284 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:56.029372 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:56.031595 (+ 2223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:56.031599 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:56.031601 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:56.031624 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:56.032959 (+ 1335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:56.033421 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:56.033424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:56.033426 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:56.033504 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:56.033848 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:56.033851 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:56.033853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:56.034030 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:56.034116 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:56.034592 (+ 476us) server_negotiation.cc:299] Negotiation successful
0808 15:56:56.034711 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 15:56:56.035595 25342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:56.023609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42879 (local address 127.19.93.2:52525)
0808 15:56:56.024123 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:56.024178 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:56.025575 (+ 1397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:56.026120 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:56.026128 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:56.026576 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:56.027187 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:56.027206 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:56.027991 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:56.027994 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:56.028921 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:56.028940 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:56.029419 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:56.029423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:56.029587 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:56.030091 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:56.030106 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:56.031430 (+ 1324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:56.033075 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:56.033081 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:56.033094 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:56.033329 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:56.033585 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:56.033588 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:56.033591 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:56.033757 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:56.034132 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:56.034138 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:56.034364 (+ 226us) client_negotiation.cc:769] Sending connection context
0808 15:56:56.034532 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 15:56:56.034832 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":116,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
I20260808 15:56:56.036672 25340 heartbeater.cc:347] Connected to a master server at 127.19.93.62:42879
I20260808 15:56:56.036931 25340 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:56.037467 25340 heartbeater.cc:511] Master 127.19.93.62:42879 requested a full tablet report, sending...
I20260808 15:56:56.038520 24816 ts_manager.cc:194] Registered new tserver with Master: 98260779c6a645d59b3c459244678ded (127.19.93.2:42953)
I20260808 15:56:56.039132 24816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:52525
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 15:56:56.050652 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42879
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:40233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:56.157974 25347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:56.158188 25347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:56.158226 25347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:56.162077 25347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:56.162123 25347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:56.162175 25347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:56:56.167079 25347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:40233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:56.167927 25347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:56.168838 25347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:56.177453 25355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:56.177489 25356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:56.177465 25359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:56.177734 25347 server_base.cc:1034] running on GCE node
I20260808 15:56:56.178122 25347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:56.178671 25347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:56.179836 25347 hybrid_clock.cc:648] HybridClock initialized: now 1786204616179814 us; error 35 us; skew 500 ppm
Aug 08 15:56:56 dist-test-slave-lgr5 krb5kdc[24746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204616, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:56.182390 25347 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:56:56.183202 25347 webserver.cc:460] Webserver started at http://127.19.93.3:37745/ using document root <none> and password file <none>
I20260808 15:56:56.183720 25347 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:56.183779 25347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:56.184003 25347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:56.186111 25347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "3235cb8e9dc0428a9ef6ef5878b99037"
format_stamp: "Formatted at 2026-08-08 15:56:56 on dist-test-slave-lgr5"
server_key: "0104113d91c7b367a57968c99d660d27"
server_key_iv: "e9cc6a559bcd698e040611d2fdc6aa59"
server_key_version: "encryptionkey@0"
I20260808 15:56:56.186638 25347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "3235cb8e9dc0428a9ef6ef5878b99037"
format_stamp: "Formatted at 2026-08-08 15:56:56 on dist-test-slave-lgr5"
server_key: "0104113d91c7b367a57968c99d660d27"
server_key_iv: "e9cc6a559bcd698e040611d2fdc6aa59"
server_key_version: "encryptionkey@0"
I20260808 15:56:56.190083 25347 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:56:56.192246 25366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:56.193378 25347 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:56:56.193487 25347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "3235cb8e9dc0428a9ef6ef5878b99037"
format_stamp: "Formatted at 2026-08-08 15:56:56 on dist-test-slave-lgr5"
server_key: "0104113d91c7b367a57968c99d660d27"
server_key_iv: "e9cc6a559bcd698e040611d2fdc6aa59"
server_key_version: "encryptionkey@0"
I20260808 15:56:56.193588 25347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:56.209756 25347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:56.212666 25347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:56.212828 25347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:56.213374 25347 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:56:56.214162 25347 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:56.214207 25347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:56.214249 25347 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:56.214278 25347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:56.222604 25347 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:40223
I20260808 15:56:56.222620 25557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:40223 every 8 connection(s)
I20260808 15:56:56.223407 25347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:56:56.226164 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 25347
I20260808 15:56:56.226267 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:56:56.226514 19828 external_mini_cluster.cc:1428] Setting key 2b2e3b17bbed994d8f5342e3b74c270d
Aug 08 15:56:56 dist-test-slave-lgr5 krb5kdc[24746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204616, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:56.236218 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:56.225127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:48007 (local address 127.19.93.62:42879)
0808 15:56:56.225258 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:56.225261 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:56.226135 (+ 874us) server_negotiation.cc:407] Connection header received
0808 15:56:56.227707 (+ 1572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:56.227710 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:56.227756 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:56.227817 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:56.229052 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:56.229575 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:56.230664 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:56.230871 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:56.230940 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:56.233221 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:56.233225 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:56.233227 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:56.233251 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:56.234486 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:56.234962 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:56.234965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:56.234966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:56.235032 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:56.235303 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:56.235304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:56.235305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:56.235454 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:56.235521 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:56.235956 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 15:56:56.236050 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:56:56.236874 25560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:56.225440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42879 (local address 127.19.93.3:48007)
0808 15:56:56.225962 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:56.226005 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:56.227516 (+ 1511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:56.228001 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:56.228010 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:56.228385 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:56.228908 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:56.228924 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:56.229697 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:56.229700 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:56.230571 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:56.230581 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:56.231007 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:56.231010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:56.231159 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:56.231660 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:56.231677 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:56.233057 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:56.234610 (+ 1553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:56.234615 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:56.234625 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:56.234881 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:56.235108 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:56.235110 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:56.235112 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:56.235233 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:56.235561 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:56.235566 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:56.235773 (+ 207us) client_negotiation.cc:769] Sending connection context
0808 15:56:56.235919 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 15:56:56.236163 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":118,"threads_started":1}
I20260808 15:56:56.237829 25558 heartbeater.cc:347] Connected to a master server at 127.19.93.62:42879
I20260808 15:56:56.238016 25558 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:56.238436 25558 heartbeater.cc:511] Master 127.19.93.62:42879 requested a full tablet report, sending...
I20260808 15:56:56.239450 24816 ts_manager.cc:194] Registered new tserver with Master: 3235cb8e9dc0428a9ef6ef5878b99037 (127.19.93.3:40223)
I20260808 15:56:56.239993 24816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:48007
I20260808 15:56:56.240113 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 15:56:56 dist-test-slave-lgr5 krb5kdc[24746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204616, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 15:56:56 dist-test-slave-lgr5 krb5kdc[24746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204616, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:56.264928 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:56.257245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38078 (local address 127.19.93.62:42879)
0808 15:56:56.257375 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:56.257379 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:56.257549 (+ 170us) server_negotiation.cc:407] Connection header received
0808 15:56:56.257688 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:56.257691 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:56.257734 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:56.257799 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:56.258461 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:56.258965 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:56.259776 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:56.259988 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:56.260113 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:56.262337 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:56.262340 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:56.262342 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:56.262366 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:56.263604 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:56.263956 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:56.263959 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:56.263960 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:56.264024 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:56.264255 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:56.264257 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:56.264258 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:56.264457 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:56.264562 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:56.264727 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 15:56:56.264814 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 15:56:56.265273 24816 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:38078
I20260808 15:56:56.266003 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 24911
I20260808 15:56:56.280459 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 25125
I20260808 15:56:56.297744 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 25347
I20260808 15:56:56.313316 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 24765
2026-08-08T15:56:56Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2192 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:56:56 dist-test-slave-lgr5 krb5kdc[25577](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:56:56 dist-test-slave-lgr5 krb5kdc[25577](info): set up 2 sockets
Aug 08 15:56:56 dist-test-slave-lgr5 krb5kdc[25577](info): commencing operation
krb5kdc: starting...
W20260808 15:56:57.462080 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:56:57 dist-test-slave-lgr5 krb5kdc[25577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:56:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:56:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:56:57.576759 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:36759
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:34041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:36759
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:57.684180 25596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:57.684409 25596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:57.684448 25596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:57.688333 25596 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:56:57.688383 25596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:57.688403 25596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:57.688428 25596 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:56:57.688452 25596 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:56:57.693378 25596 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:34041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:36759
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:36759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:57.694233 25596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:57.695123 25596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:57.703097 25608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:57.703118 25602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:57.703176 25596 server_base.cc:1034] running on GCE node
W20260808 15:56:57.703107 25603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:57.703852 25596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:57.704888 25596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:57.706043 25596 hybrid_clock.cc:648] HybridClock initialized: now 1786204617706023 us; error 33 us; skew 500 ppm
Aug 08 15:56:57 dist-test-slave-lgr5 krb5kdc[25577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204617, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:57.708693 25596 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:56:57.709491 25596 webserver.cc:460] Webserver started at http://127.19.93.62:35225/ using document root <none> and password file <none>
I20260808 15:56:57.709987 25596 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:57.710050 25596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:57.710219 25596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:57.712152 25596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "e8fb7105d1634ac58258455a333604d5"
format_stamp: "Formatted at 2026-08-08 15:56:57 on dist-test-slave-lgr5"
server_key: "fe30572cd5f1fd6014d8335c87cdabb0"
server_key_iv: "d5188dc36e5c50fec37ffebd6347cb21"
server_key_version: "encryptionkey@0"
I20260808 15:56:57.712692 25596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "e8fb7105d1634ac58258455a333604d5"
format_stamp: "Formatted at 2026-08-08 15:56:57 on dist-test-slave-lgr5"
server_key: "fe30572cd5f1fd6014d8335c87cdabb0"
server_key_iv: "d5188dc36e5c50fec37ffebd6347cb21"
server_key_version: "encryptionkey@0"
I20260808 15:56:57.716315 25596 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260808 15:56:57.718575 25622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:57.719637 25596 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:56:57.719756 25596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "e8fb7105d1634ac58258455a333604d5"
format_stamp: "Formatted at 2026-08-08 15:56:57 on dist-test-slave-lgr5"
server_key: "fe30572cd5f1fd6014d8335c87cdabb0"
server_key_iv: "d5188dc36e5c50fec37ffebd6347cb21"
server_key_version: "encryptionkey@0"
I20260808 15:56:57.719848 25596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:57.731724 25596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:57.734215 25596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:57.734364 25596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:57.741032 25596 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:36759
I20260808 15:56:57.741086 25713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:36759 every 8 connection(s)
I20260808 15:56:57.741916 25596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:56:57.744413 25716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:57.749435 25716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5: Bootstrap starting.
I20260808 15:56:57.751583 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 25596
I20260808 15:56:57.751683 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:56:57.751680 25716 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:57.751948 19828 external_mini_cluster.cc:1428] Setting key d41a7d06ffdbd74a3ef21976ade7819a
I20260808 15:56:57.752465 25716 log.cc:824] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5: Log is configured to *not* fsync() on all Append() calls
I20260808 15:56:57.754549 25716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5: No bootstrap required, opened a new log
I20260808 15:56:57.758598 25716 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8fb7105d1634ac58258455a333604d5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36759 } }
I20260808 15:56:57.758842 25716 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:57.758910 25716 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fb7105d1634ac58258455a333604d5, State: Initialized, Role: FOLLOWER
I20260808 15:56:57.759336 25716 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8fb7105d1634ac58258455a333604d5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36759 } }
I20260808 15:56:57.759495 25716 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:56:57.759605 25716 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:56:57.759711 25716 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:57.760555 25716 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8fb7105d1634ac58258455a333604d5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36759 } }
I20260808 15:56:57.760855 25716 leader_election.cc:302] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8fb7105d1634ac58258455a333604d5; no voters:
Aug 08 15:56:57 dist-test-slave-lgr5 krb5kdc[25577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:57.761132 25716 leader_election.cc:288] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:56:57.761216 25724 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:57.761410 25724 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [term 1 LEADER]: Becoming Leader. State: Replica: e8fb7105d1634ac58258455a333604d5, State: Running, Role: LEADER
I20260808 15:56:57.761744 25724 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8fb7105d1634ac58258455a333604d5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36759 } }
I20260808 15:56:57.762310 25716 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:56:57.763455 25728 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8fb7105d1634ac58258455a333604d5. Latest consensus state: current_term: 1 leader_uuid: "e8fb7105d1634ac58258455a333604d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8fb7105d1634ac58258455a333604d5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36759 } } }
I20260808 15:56:57.763491 25727 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8fb7105d1634ac58258455a333604d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8fb7105d1634ac58258455a333604d5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36759 } } }
I20260808 15:56:57.763584 25728 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [sys.catalog]: This master's current role is: LEADER
I20260808 15:56:57.763619 25727 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5 [sys.catalog]: This master's current role is: LEADER
I20260808 15:56:57.763957 25738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:56:57.766845 25723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:57.753169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57756 (local address 127.19.93.62:36759)
0808 15:56:57.753601 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:57.753619 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:57.753659 (+ 40us) server_negotiation.cc:407] Connection header received
0808 15:56:57.754426 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:57.754447 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:57.754815 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:57.755178 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:57.755795 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:57.757310 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:57.758227 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:57.758920 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:57.759088 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:57.761830 (+ 2742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:57.761837 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:57.761853 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:57.761888 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:57.763958 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:57.764514 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:57.764521 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:57.764527 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:57.764647 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:57.764957 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:57.764960 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:57.764962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:57.765339 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:57.765543 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:57.765873 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 15:56:57.766174 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":128,"threads_started":1}
I20260808 15:56:57.767906 25738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:56:57.774164 25738 catalog_manager.cc:1347] Generated new cluster ID: 994a38e474d14c0386ff31ebfbd8cec6
I20260808 15:56:57.774228 25738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:56:57.780140 25738 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:56:57.781265 25738 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:56:57.786546 25738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e8fb7105d1634ac58258455a333604d5: Generated new TSK 0
I20260808 15:56:57.787190 25738 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 15:56:57.820103 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36759
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:34041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:57.946926 25757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:57.947152 25757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:57.947189 25757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:57.951128 25757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:57.951175 25757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:57.951228 25757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:56:57.956398 25757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:34041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36759
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:57.957366 25757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:57.958317 25757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:57.967281 25767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:57.967301 25771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:57.967296 25768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:57.967564 25757 server_base.cc:1034] running on GCE node
I20260808 15:56:57.967952 25757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:57.968595 25757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:57.969781 25757 hybrid_clock.cc:648] HybridClock initialized: now 1786204617969766 us; error 30 us; skew 500 ppm
Aug 08 15:56:57 dist-test-slave-lgr5 krb5kdc[25577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204617, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:57.972776 25757 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:56:57.973768 25757 webserver.cc:460] Webserver started at http://127.19.93.1:44889/ using document root <none> and password file <none>
I20260808 15:56:57.974422 25757 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:57.974563 25757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:57.974817 25757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:57.977406 25757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "a19e1574d69445928b498343ea9dbc19"
format_stamp: "Formatted at 2026-08-08 15:56:57 on dist-test-slave-lgr5"
server_key: "2dd32d921555fcbb6b46c47211eb695e"
server_key_iv: "b6136bf0d6c3da1f3fa57b1a88fc7ee8"
server_key_version: "encryptionkey@0"
I20260808 15:56:57.977916 25757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "a19e1574d69445928b498343ea9dbc19"
format_stamp: "Formatted at 2026-08-08 15:56:57 on dist-test-slave-lgr5"
server_key: "2dd32d921555fcbb6b46c47211eb695e"
server_key_iv: "b6136bf0d6c3da1f3fa57b1a88fc7ee8"
server_key_version: "encryptionkey@0"
I20260808 15:56:57.981475 25757 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:56:57.983667 25778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:57.984838 25757 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:56:57.984934 25757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "a19e1574d69445928b498343ea9dbc19"
format_stamp: "Formatted at 2026-08-08 15:56:57 on dist-test-slave-lgr5"
server_key: "2dd32d921555fcbb6b46c47211eb695e"
server_key_iv: "b6136bf0d6c3da1f3fa57b1a88fc7ee8"
server_key_version: "encryptionkey@0"
I20260808 15:56:57.985016 25757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:58.001269 25757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:58.004163 25757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:58.004318 25757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:58.004874 25757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:56:58.005676 25757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:58.005723 25757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:58.005762 25757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:58.005782 25757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:58.014183 25757 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:36521
I20260808 15:56:58.014271 25960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:36521 every 8 connection(s)
I20260808 15:56:58.015076 25757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:56:58.016444 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 25757
I20260808 15:56:58.016562 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:56:58.016877 19828 external_mini_cluster.cc:1428] Setting key 07f907b83f7fd691416cee583bc14374
Aug 08 15:56:58 dist-test-slave-lgr5 krb5kdc[25577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204617, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
I20260808 15:56:58.029502 25723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:58.016863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:57547 (local address 127.19.93.62:36759)
0808 15:56:58.017020 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:58.017024 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:58.017915 (+ 891us) server_negotiation.cc:407] Connection header received
0808 15:56:58.019308 (+ 1393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:58.019311 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:58.019370 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:58.019445 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:58.020896 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:58.021435 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:58.022977 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:58.023257 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:58.023336 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:58.026014 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:58.026018 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:58.026020 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:58.026047 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:58.027375 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:58.027855 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:58.027858 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:58.027860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:58.027942 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:58.028282 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:58.028285 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:58.028287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:58.028543 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:58.028640 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:58.029129 (+ 489us) server_negotiation.cc:299] Negotiation successful
0808 15:56:58.029252 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
I20260808 15:56:58.030236 25963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:58.017255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36759 (local address 127.19.93.1:57547)
0808 15:56:58.017765 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:58.017818 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:58.019088 (+ 1270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:58.019615 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:58.019622 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:58.020044 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:58.020733 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:58.020752 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:58.021558 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:58.021561 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:58.022844 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:58.022858 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:58.023399 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:58.023404 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:58.023606 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:58.024271 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:58.024287 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:58.025852 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:58.027503 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:58.027509 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:58.027524 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:58.027759 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:58.028024 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:58.028027 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:58.028029 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:58.028195 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:58.028640 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:58.028646 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:58.028886 (+ 240us) client_negotiation.cc:769] Sending connection context
0808 15:56:58.029043 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 15:56:58.029342 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":139,"threads_started":1}
I20260808 15:56:58.031342 25961 heartbeater.cc:347] Connected to a master server at 127.19.93.62:36759
I20260808 15:56:58.031607 25961 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:58.032068 25961 heartbeater.cc:511] Master 127.19.93.62:36759 requested a full tablet report, sending...
I20260808 15:56:58.033535 25655 ts_manager.cc:194] Registered new tserver with Master: a19e1574d69445928b498343ea9dbc19 (127.19.93.1:36521)
I20260808 15:56:58.034619 25655 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:57547
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 15:56:58.044332 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36759
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:34041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:58.152107 25970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:58.152329 25970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:58.152376 25970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:58.156351 25970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:58.156405 25970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:58.156459 25970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:56:58.161445 25970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:34041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36759
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:58.162395 25970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:58.163347 25970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:58.172291 25979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:58.172405 25985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:58.172297 25981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:58.172582 25970 server_base.cc:1034] running on GCE node
I20260808 15:56:58.172953 25970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:58.173543 25970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:58.174700 25970 hybrid_clock.cc:648] HybridClock initialized: now 1786204618174676 us; error 36 us; skew 500 ppm
Aug 08 15:56:58 dist-test-slave-lgr5 krb5kdc[25577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204618, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:58.177292 25970 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:56:58.178108 25970 webserver.cc:460] Webserver started at http://127.19.93.2:40469/ using document root <none> and password file <none>
I20260808 15:56:58.178615 25970 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:58.178674 25970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:58.178866 25970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:58.180806 25970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "9db50fd0f52a4de5b116a93c777f1e1e"
format_stamp: "Formatted at 2026-08-08 15:56:58 on dist-test-slave-lgr5"
server_key: "f403504c886546b606ca3f8354488ad5"
server_key_iv: "aae1ff7c0aa4f2c02346cac9aa3b5ef5"
server_key_version: "encryptionkey@0"
I20260808 15:56:58.181308 25970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "9db50fd0f52a4de5b116a93c777f1e1e"
format_stamp: "Formatted at 2026-08-08 15:56:58 on dist-test-slave-lgr5"
server_key: "f403504c886546b606ca3f8354488ad5"
server_key_iv: "aae1ff7c0aa4f2c02346cac9aa3b5ef5"
server_key_version: "encryptionkey@0"
I20260808 15:56:58.184674 25970 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:56:58.186864 25999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:58.187987 25970 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:56:58.188113 25970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "9db50fd0f52a4de5b116a93c777f1e1e"
format_stamp: "Formatted at 2026-08-08 15:56:58 on dist-test-slave-lgr5"
server_key: "f403504c886546b606ca3f8354488ad5"
server_key_iv: "aae1ff7c0aa4f2c02346cac9aa3b5ef5"
server_key_version: "encryptionkey@0"
I20260808 15:56:58.188202 25970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:58.201783 25970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:58.204176 25970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:58.204330 25970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:58.204849 25970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:56:58.205586 25970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:58.205631 25970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:58.205680 25970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:58.205708 25970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:58.213753 25970 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:42367
I20260808 15:56:58.213778 26168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:42367 every 8 connection(s)
I20260808 15:56:58.214532 25970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:56:58.220434 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 25970
I20260808 15:56:58.220569 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:56:58.220853 19828 external_mini_cluster.cc:1428] Setting key de297a66a24f6c9c2ce015a97e62a0ff
Aug 08 15:56:58 dist-test-slave-lgr5 krb5kdc[25577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204618, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:58.228217 25723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:58.216271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:48629 (local address 127.19.93.62:36759)
0808 15:56:58.216426 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:58.216430 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:58.217221 (+ 791us) server_negotiation.cc:407] Connection header received
0808 15:56:58.218583 (+ 1362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:58.218587 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:58.218644 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:58.218715 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:58.219794 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:58.220405 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:58.221669 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:58.221907 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:58.222012 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:58.224670 (+ 2658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:58.224674 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:58.224677 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:58.224704 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:58.226120 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:58.226654 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:58.226658 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:58.226659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:58.226748 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:58.227073 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:58.227076 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:58.227077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:58.227310 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:58.227412 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:58.227881 (+ 469us) server_negotiation.cc:299] Negotiation successful
0808 15:56:58.228012 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 15:56:58.228909 26174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:58.216634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36759 (local address 127.19.93.2:48629)
0808 15:56:58.217087 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:58.217126 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:58.218384 (+ 1258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:58.218880 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:58.218887 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:58.219211 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:58.219651 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:58.219665 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:58.220528 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:58.220531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:58.221548 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:58.221561 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:58.222075 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:58.222079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:58.222270 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:58.222791 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:58.222806 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:58.224490 (+ 1684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:58.226239 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:58.226244 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:58.226254 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:58.226550 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:58.226831 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:58.226833 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:58.226834 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:58.226969 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:58.227423 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:58.227428 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:58.227650 (+ 222us) client_negotiation.cc:769] Sending connection context
0808 15:56:58.227812 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 15:56:58.228062 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":131,"threads_started":1}
I20260808 15:56:58.230018 26171 heartbeater.cc:347] Connected to a master server at 127.19.93.62:36759
I20260808 15:56:58.230238 26171 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:58.230700 26171 heartbeater.cc:511] Master 127.19.93.62:36759 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
I20260808 15:56:58.231660 25655 ts_manager.cc:194] Registered new tserver with Master: 9db50fd0f52a4de5b116a93c777f1e1e (127.19.93.2:42367)
I20260808 15:56:58.232254 25655 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:48629
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 15:56:58.247061 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36759
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:34041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:58.354354 26179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:58.354597 26179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:58.354657 26179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:58.358597 26179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:58.358649 26179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:58.358724 26179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:56:58.363837 26179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:34041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36759
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:58.364836 26179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:58.365759 26179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:58.374754 26200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:58.374802 26194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:58.374789 26193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:58.375113 26179 server_base.cc:1034] running on GCE node
I20260808 15:56:58.375465 26179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:58.376041 26179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:58.377218 26179 hybrid_clock.cc:648] HybridClock initialized: now 1786204618377204 us; error 29 us; skew 500 ppm
Aug 08 15:56:58 dist-test-slave-lgr5 krb5kdc[25577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204618, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:58.379699 26179 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:56:58.380540 26179 webserver.cc:460] Webserver started at http://127.19.93.3:39177/ using document root <none> and password file <none>
I20260808 15:56:58.381079 26179 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:58.381140 26179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:58.381326 26179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:58.383198 26179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "e58fbc11bad442e1865b440cc3e5f8fe"
format_stamp: "Formatted at 2026-08-08 15:56:58 on dist-test-slave-lgr5"
server_key: "e53fd737f201cc862a08bf26c372391b"
server_key_iv: "cd92683338d692b837ecb6caa228813a"
server_key_version: "encryptionkey@0"
I20260808 15:56:58.383700 26179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "e58fbc11bad442e1865b440cc3e5f8fe"
format_stamp: "Formatted at 2026-08-08 15:56:58 on dist-test-slave-lgr5"
server_key: "e53fd737f201cc862a08bf26c372391b"
server_key_iv: "cd92683338d692b837ecb6caa228813a"
server_key_version: "encryptionkey@0"
I20260808 15:56:58.387064 26179 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.001s
I20260808 15:56:58.389422 26213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:58.390532 26179 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:56:58.390661 26179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "e58fbc11bad442e1865b440cc3e5f8fe"
format_stamp: "Formatted at 2026-08-08 15:56:58 on dist-test-slave-lgr5"
server_key: "e53fd737f201cc862a08bf26c372391b"
server_key_iv: "cd92683338d692b837ecb6caa228813a"
server_key_version: "encryptionkey@0"
I20260808 15:56:58.390746 26179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:58.403155 26179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:58.405646 26179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:58.405804 26179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:58.406332 26179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:56:58.407096 26179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:56:58.407141 26179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:58.407192 26179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:56:58.407220 26179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:58.415684 26179 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:34801
I20260808 15:56:58.415714 26391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:34801 every 8 connection(s)
I20260808 15:56:58.416500 26179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:56:58.422266 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 26179
I20260808 15:56:58.422367 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:56:58.422628 19828 external_mini_cluster.cc:1428] Setting key cf15fd1dd82be6ac0022950ce9581331
Aug 08 15:56:58 dist-test-slave-lgr5 krb5kdc[25577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204618, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:58.429258 25723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:58.418146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:38319 (local address 127.19.93.62:36759)
0808 15:56:58.418281 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:58.418285 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:58.419048 (+ 763us) server_negotiation.cc:407] Connection header received
0808 15:56:58.420399 (+ 1351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:58.420402 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:58.420464 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:58.420537 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:58.421630 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:58.422156 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:58.423531 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:58.423830 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:58.423931 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:58.426383 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:58.426386 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:58.426388 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:58.426413 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:58.427478 (+ 1065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:58.427892 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:58.427894 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:58.427895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:58.427959 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:58.428302 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:58.428307 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:58.428309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:58.428517 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:58.428618 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:58.429032 (+ 414us) server_negotiation.cc:299] Negotiation successful
0808 15:56:58.429139 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:56:58.429970 26398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:58.418473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36759 (local address 127.19.93.3:38319)
0808 15:56:58.418909 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0808 15:56:58.418950 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 15:56:58.420195 (+ 1245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:56:58.420707 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:56:58.420713 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:56:58.421032 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:56:58.421480 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:58.421494 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:58.422293 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:58.422296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:58.423417 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:56:58.423429 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:56:58.424010 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:56:58.424015 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:56:58.424228 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:58.424813 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:56:58.424832 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:56:58.426226 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:56:58.427574 (+ 1348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:58.427578 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:58.427588 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:58.427819 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:58.428019 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:56:58.428021 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:56:58.428022 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:56:58.428155 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:56:58.428616 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:56:58.428621 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:56:58.428827 (+ 206us) client_negotiation.cc:769] Sending connection context
0808 15:56:58.428971 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 15:56:58.429196 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":114,"threads_started":1}
I20260808 15:56:58.430964 26392 heartbeater.cc:347] Connected to a master server at 127.19.93.62:36759
I20260808 15:56:58.431166 26392 heartbeater.cc:464] Registering TS with master...
I20260808 15:56:58.431618 26392 heartbeater.cc:511] Master 127.19.93.62:36759 requested a full tablet report, sending...
I20260808 15:56:58.432564 25655 ts_manager.cc:194] Registered new tserver with Master: e58fbc11bad442e1865b440cc3e5f8fe (127.19.93.3:34801)
I20260808 15:56:58.433076 25655 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:38319
I20260808 15:56:58.436822 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 15:56:58 dist-test-slave-lgr5 krb5kdc[25577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 15:56:58 dist-test-slave-lgr5 krb5kdc[25577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.1@KRBTEST.COM
I20260808 15:56:58.461464 26407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:58.452968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54894 (local address 127.19.93.1:36521)
0808 15:56:58.453318 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:58.453327 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:58.453348 (+ 21us) server_negotiation.cc:407] Connection header received
0808 15:56:58.453402 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:58.453407 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:58.453567 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:58.453679 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:58.454335 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:58.455139 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:58.455925 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:58.456302 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:58.456392 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:58.458457 (+ 2065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:58.458466 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:58.458477 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:58.458501 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:58.459943 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:58.460321 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:58.460325 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:58.460327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:58.460432 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:58.460610 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:58.460611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:58.460612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:58.460817 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:58.460956 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:58.461147 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 15:56:58.461269 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":139,"threads_started":1}
Aug 08 15:56:58 dist-test-slave-lgr5 krb5kdc[25577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:58.471907 25723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:58.464140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57766 (local address 127.19.93.62:36759)
0808 15:56:58.464265 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:58.464269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:58.464363 (+ 94us) server_negotiation.cc:407] Connection header received
0808 15:56:58.464604 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:58.464607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:58.464651 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:58.464724 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:58.465380 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:58.465873 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:58.466783 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:58.467022 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:58.467114 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:58.469306 (+ 2192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:58.469309 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:58.469311 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:58.469352 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:58.470468 (+ 1116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:58.470863 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:58.470865 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:58.470866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:58.470926 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:58.471132 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:58.471134 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:58.471135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:58.471322 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:58.471437 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:58.471675 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 15:56:58.471760 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 15:56:58.472296 25655 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57766
I20260808 15:56:58.472870 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 25757
I20260808 15:56:58.484733 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 25970
I20260808 15:56:58.493036 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 26179
I20260808 15:56:58.508316 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 25596
2026-08-08T15:56:58Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2196 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:56:58 dist-test-slave-lgr5 krb5kdc[26414](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:56:58 dist-test-slave-lgr5 krb5kdc[26414](info): set up 2 sockets
Aug 08 15:56:58 dist-test-slave-lgr5 krb5kdc[26414](info): commencing operation
krb5kdc: starting...
W20260808 15:56:59.658980 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:56:59 dist-test-slave-lgr5 krb5kdc[26414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:56:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:56:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:56:59.771518 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:41289
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:41289
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:56:59.877310 26432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:56:59.877530 26432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:56:59.877596 26432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:56:59.881474 26432 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:56:59.881521 26432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:56:59.881556 26432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:56:59.881583 26432 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:56:59.881611 26432 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:56:59.886515 26432 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:41289
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:41289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:56:59.887384 26432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:56:59.888314 26432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:56:59.895699 26440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:59.895697 26438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:56:59.895823 26444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:56:59.895942 26432 server_base.cc:1034] running on GCE node
I20260808 15:56:59.896493 26432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:56:59.897462 26432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:56:59.898607 26432 hybrid_clock.cc:648] HybridClock initialized: now 1786204619898587 us; error 33 us; skew 500 ppm
Aug 08 15:56:59 dist-test-slave-lgr5 krb5kdc[26414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:56:59.901197 26432 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:56:59.901842 26432 fs_manager.cc:359] Metadata directory not provided
I20260808 15:56:59.901917 26432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:56:59.902103 26432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:56:59.903966 26432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "acf9638d63004fbd9f74ee2798b59ac6"
format_stamp: "Formatted at 2026-08-08 15:56:59 on dist-test-slave-lgr5"
server_key: "b057500f3ecb811fd1ac8d99a40a87b9"
server_key_iv: "3296a29189abec1c67101814006f77f2"
server_key_version: "encryptionkey@0"
I20260808 15:56:59.904516 26432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "acf9638d63004fbd9f74ee2798b59ac6"
format_stamp: "Formatted at 2026-08-08 15:56:59 on dist-test-slave-lgr5"
server_key: "b057500f3ecb811fd1ac8d99a40a87b9"
server_key_iv: "3296a29189abec1c67101814006f77f2"
server_key_version: "encryptionkey@0"
I20260808 15:56:59.907894 26432 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:56:59.910022 26455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:56:59.911121 26432 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:56:59.911237 26432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "acf9638d63004fbd9f74ee2798b59ac6"
format_stamp: "Formatted at 2026-08-08 15:56:59 on dist-test-slave-lgr5"
server_key: "b057500f3ecb811fd1ac8d99a40a87b9"
server_key_iv: "3296a29189abec1c67101814006f77f2"
server_key_version: "encryptionkey@0"
I20260808 15:56:59.911326 26432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:56:59.939471 26432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:56:59.942008 26432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:56:59.942167 26432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:56:59.948513 26432 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:41289
I20260808 15:56:59.948753 26533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:41289 every 8 connection(s)
I20260808 15:56:59.949121 26432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:56:59.951699 26534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:56:59.956573 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 26432
I20260808 15:56:59.956694 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:56:59.956943 19828 external_mini_cluster.cc:1428] Setting key 9a7d7a2514e1ab35fb86a7b38e20ad93
I20260808 15:56:59.957195 26534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6: Bootstrap starting.
I20260808 15:56:59.959478 26534 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6: Neither blocks nor log segments found. Creating new log.
I20260808 15:56:59.960330 26534 log.cc:824] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6: Log is configured to *not* fsync() on all Append() calls
I20260808 15:56:59.962306 26534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6: No bootstrap required, opened a new log
Aug 08 15:56:59 dist-test-slave-lgr5 krb5kdc[26414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:56:59.966398 26534 raft_consensus.cc:348] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acf9638d63004fbd9f74ee2798b59ac6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 41289 } }
I20260808 15:56:59.966634 26534 raft_consensus.cc:374] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:56:59.966702 26534 raft_consensus.cc:729] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acf9638d63004fbd9f74ee2798b59ac6, State: Initialized, Role: FOLLOWER
I20260808 15:56:59.967159 26534 consensus_queue.cc:260] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acf9638d63004fbd9f74ee2798b59ac6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 41289 } }
I20260808 15:56:59.967320 26534 raft_consensus.cc:388] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:56:59.967391 26534 raft_consensus.cc:482] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:56:59.967494 26534 raft_consensus.cc:3037] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:56:59.968375 26534 raft_consensus.cc:504] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acf9638d63004fbd9f74ee2798b59ac6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 41289 } }
I20260808 15:56:59.968715 26534 leader_election.cc:302] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: acf9638d63004fbd9f74ee2798b59ac6; no voters:
I20260808 15:56:59.969050 26534 leader_election.cc:288] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:56:59.969138 26544 raft_consensus.cc:2781] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:56:59.969337 26544 raft_consensus.cc:686] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [term 1 LEADER]: Becoming Leader. State: Replica: acf9638d63004fbd9f74ee2798b59ac6, State: Running, Role: LEADER
I20260808 15:56:59.969672 26544 consensus_queue.cc:237] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acf9638d63004fbd9f74ee2798b59ac6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 41289 } }
I20260808 15:56:59.970284 26534 sys_catalog.cc:564] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:56:59.971029 26541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:56:59.958253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33444 (local address 127.19.93.62:41289)
0808 15:56:59.958635 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0808 15:56:59.958650 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:56:59.958683 (+ 33us) server_negotiation.cc:407] Connection header received
0808 15:56:59.959293 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:56:59.959308 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:56:59.959649 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:56:59.959911 (+ 262us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:56:59.960837 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:59.961908 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:59.963030 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:56:59.963491 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:56:59.963604 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:56:59.966294 (+ 2690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:56:59.966298 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:56:59.966310 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:56:59.966337 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:56:59.968027 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:59.968520 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:59.968526 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:59.968532 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:59.968650 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:56:59.968957 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:56:59.968960 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:56:59.968961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:56:59.969455 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:56:59.969651 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 15:56:59.969913 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 15:56:59.970212 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":113,"threads_started":1}
I20260808 15:56:59.971277 26545 sys_catalog.cc:455] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "acf9638d63004fbd9f74ee2798b59ac6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acf9638d63004fbd9f74ee2798b59ac6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 41289 } } }
I20260808 15:56:59.971403 26545 sys_catalog.cc:458] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [sys.catalog]: This master's current role is: LEADER
I20260808 15:56:59.971654 26545 sys_catalog.cc:455] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader acf9638d63004fbd9f74ee2798b59ac6. Latest consensus state: current_term: 1 leader_uuid: "acf9638d63004fbd9f74ee2798b59ac6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acf9638d63004fbd9f74ee2798b59ac6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 41289 } } }
I20260808 15:56:59.971758 26545 sys_catalog.cc:458] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6 [sys.catalog]: This master's current role is: LEADER
I20260808 15:56:59.972100 26558 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:56:59.975204 26558 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:56:59.981851 26558 catalog_manager.cc:1347] Generated new cluster ID: af8fe5c8ae6a4ef0acd6e7644ee56266
I20260808 15:56:59.981906 26558 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:56:59.995023 26558 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:56:59.996300 26558 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:57:00.001933 26558 catalog_manager.cc:5868] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6: Generated new TSK 0
I20260808 15:57:00.002669 26558 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 15:57:00.038677 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:41289
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:00.149545 26575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:00.149802 26575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:00.149844 26575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:00.153815 26575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:00.153869 26575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:00.153944 26575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:57:00.159492 26575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:41289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:00.160519 26575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:00.161512 26575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:00.170471 26589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:00.170471 26584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:00.170604 26575 server_base.cc:1034] running on GCE node
W20260808 15:57:00.170913 26585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:00.171335 26575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:00.171911 26575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:00.173076 26575 hybrid_clock.cc:648] HybridClock initialized: now 1786204620173055 us; error 35 us; skew 500 ppm
Aug 08 15:57:00 dist-test-slave-lgr5 krb5kdc[26414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:00.175724 26575 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:57:00.176426 26575 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:00.176489 26575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:00.176656 26575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:00.178571 26575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "fa51c277aa16403d99f21568244fe09c"
format_stamp: "Formatted at 2026-08-08 15:57:00 on dist-test-slave-lgr5"
server_key: "4d8a54186bded69091d1e5975333cb64"
server_key_iv: "07261185423870a2e75b86a84c566978"
server_key_version: "encryptionkey@0"
I20260808 15:57:00.179068 26575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "fa51c277aa16403d99f21568244fe09c"
format_stamp: "Formatted at 2026-08-08 15:57:00 on dist-test-slave-lgr5"
server_key: "4d8a54186bded69091d1e5975333cb64"
server_key_iv: "07261185423870a2e75b86a84c566978"
server_key_version: "encryptionkey@0"
I20260808 15:57:00.182458 26575 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:57:00.184635 26597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:00.185766 26575 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:57:00.185873 26575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "fa51c277aa16403d99f21568244fe09c"
format_stamp: "Formatted at 2026-08-08 15:57:00 on dist-test-slave-lgr5"
server_key: "4d8a54186bded69091d1e5975333cb64"
server_key_iv: "07261185423870a2e75b86a84c566978"
server_key_version: "encryptionkey@0"
I20260808 15:57:00.185969 26575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:00.220827 26575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:00.223727 26575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:00.223924 26575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:00.224547 26575 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:00.225404 26575 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:00.225451 26575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:00.225505 26575 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:00.225534 26575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:00.233821 26575 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:32963
I20260808 15:57:00.233862 26781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:32963 every 8 connection(s)
I20260808 15:57:00.234392 26575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:57:00.235008 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 26575
I20260808 15:57:00.235136 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:57:00.235419 19828 external_mini_cluster.cc:1428] Setting key 67a07e3241f4fcbabbfbcfbd7919e14e
Aug 08 15:57:00 dist-test-slave-lgr5 krb5kdc[26414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
I20260808 15:57:00.248220 26541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.236110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:35459 (local address 127.19.93.62:41289)
0808 15:57:00.236639 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:00.236644 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:00.237523 (+ 879us) server_negotiation.cc:407] Connection header received
0808 15:57:00.238560 (+ 1037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:00.238562 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:00.238606 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:00.238665 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:00.239835 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.240522 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.242098 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.242319 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.242395 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.245078 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:00.245081 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:00.245084 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:00.245107 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:00.246419 (+ 1312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:00.246920 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:00.246923 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:00.246924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:00.247001 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:00.247252 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:00.247254 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:00.247255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:00.247411 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:00.247479 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:00.247941 (+ 462us) server_negotiation.cc:299] Negotiation successful
0808 15:57:00.248042 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450}
I20260808 15:57:00.249024 26786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.236475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:41289 (local address 127.19.93.1:35459)
0808 15:57:00.237352 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:00.237422 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:00.238329 (+ 907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:00.238841 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:00.238850 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:00.239243 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:00.239704 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:00.239717 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.240657 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.240660 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:00.241982 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:00.241996 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.242468 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.242472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:00.242667 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.243222 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:00.243243 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:00.244915 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:00.246525 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:00.246530 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:00.246540 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:00.246837 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:00.247071 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:00.247073 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:00.247074 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:00.247191 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:00.247480 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:00.247484 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:00.247745 (+ 261us) client_negotiation.cc:769] Sending connection context
0808 15:57:00.247890 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 15:57:00.248195 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":102,"threads_started":1}
I20260808 15:57:00.250216 26782 heartbeater.cc:347] Connected to a master server at 127.19.93.62:41289
I20260808 15:57:00.250433 26782 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:00.250844 26782 heartbeater.cc:511] Master 127.19.93.62:41289 requested a full tablet report, sending...
I20260808 15:57:00.252434 26482 ts_manager.cc:194] Registered new tserver with Master: fa51c277aa16403d99f21568244fe09c (127.19.93.1:32963)
I20260808 15:57:00.253948 26482 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:35459
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 15:57:00.263456 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:41289
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:00.373991 26791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:00.374215 26791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:00.374256 26791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:00.378504 26791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:00.378556 26791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:00.378612 26791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:57:00.383535 26791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:41289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:00.384461 26791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:00.385375 26791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:00.393975 26798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:00.393980 26800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:00.393980 26797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:00.394496 26791 server_base.cc:1034] running on GCE node
I20260808 15:57:00.394850 26791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:00.395419 26791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:00.396574 26791 hybrid_clock.cc:648] HybridClock initialized: now 1786204620396559 us; error 24 us; skew 500 ppm
Aug 08 15:57:00 dist-test-slave-lgr5 krb5kdc[26414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:00.399098 26791 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:57:00.399756 26791 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:00.399824 26791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:00.400002 26791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:00.401901 26791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "b254c63f7d984bdcb0850a77520c4173"
format_stamp: "Formatted at 2026-08-08 15:57:00 on dist-test-slave-lgr5"
server_key: "57cd0bee1821cd77f0507cdd881ea61f"
server_key_iv: "1d32116835572b764de82996fd2a6252"
server_key_version: "encryptionkey@0"
I20260808 15:57:00.402426 26791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "b254c63f7d984bdcb0850a77520c4173"
format_stamp: "Formatted at 2026-08-08 15:57:00 on dist-test-slave-lgr5"
server_key: "57cd0bee1821cd77f0507cdd881ea61f"
server_key_iv: "1d32116835572b764de82996fd2a6252"
server_key_version: "encryptionkey@0"
I20260808 15:57:00.405814 26791 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:57:00.408006 26808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:00.409191 26791 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:00.409304 26791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "b254c63f7d984bdcb0850a77520c4173"
format_stamp: "Formatted at 2026-08-08 15:57:00 on dist-test-slave-lgr5"
server_key: "57cd0bee1821cd77f0507cdd881ea61f"
server_key_iv: "1d32116835572b764de82996fd2a6252"
server_key_version: "encryptionkey@0"
I20260808 15:57:00.409392 26791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:00.423717 26791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:00.426604 26791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:00.426769 26791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:00.427299 26791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:00.428071 26791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:00.428148 26791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:00.428210 26791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:00.428234 26791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:00.436542 26791 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:44227
I20260808 15:57:00.436565 26991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:44227 every 8 connection(s)
I20260808 15:57:00.437055 26791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:57:00.439258 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 26791
I20260808 15:57:00.439381 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:57:00.439706 19828 external_mini_cluster.cc:1428] Setting key 7de721c4320be75dda7a56f7a2348c35
Aug 08 15:57:00 dist-test-slave-lgr5 krb5kdc[26414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:57:00.449965 26541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.438570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:55707 (local address 127.19.93.62:41289)
0808 15:57:00.438723 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:00.438728 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:00.439914 (+ 1186us) server_negotiation.cc:407] Connection header received
0808 15:57:00.440813 (+ 899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:00.440816 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:00.440861 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:00.440939 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:00.442090 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.442786 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.443884 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.444147 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.444240 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.446664 (+ 2424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:00.446667 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:00.446669 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:00.446694 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:00.447931 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:00.448525 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:00.448527 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:00.448528 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:00.448602 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:00.448959 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:00.448961 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:00.448962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:00.449115 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:00.449183 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:00.449740 (+ 557us) server_negotiation.cc:299] Negotiation successful
0808 15:57:00.449840 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
I20260808 15:57:00.450798 26998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.438923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:41289 (local address 127.19.93.2:55707)
0808 15:57:00.439768 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:00.439821 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:00.440632 (+ 811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:00.441087 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:00.441095 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:00.441493 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:00.441934 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:00.441948 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.442898 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.442900 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:00.443754 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:00.443764 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.444280 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.444284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:00.444471 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.444962 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:00.444976 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:00.446496 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:00.448050 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:00.448056 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:00.448069 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:00.448433 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:00.448683 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:00.448686 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:00.448688 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:00.448877 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:00.449209 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:00.449216 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:00.449509 (+ 293us) client_negotiation.cc:769] Sending connection context
0808 15:57:00.449721 (+ 212us) client_negotiation.cc:240] Negotiation successful
0808 15:57:00.450023 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":152,"threads_started":1}
I20260808 15:57:00.451965 26992 heartbeater.cc:347] Connected to a master server at 127.19.93.62:41289
I20260808 15:57:00.452240 26992 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:00.452690 26992 heartbeater.cc:511] Master 127.19.93.62:41289 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
I20260808 15:57:00.453663 26482 ts_manager.cc:194] Registered new tserver with Master: b254c63f7d984bdcb0850a77520c4173 (127.19.93.2:44227)
I20260808 15:57:00.454258 26482 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:55707
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 15:57:00.466847 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:41289
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:00.574434 27001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:00.574649 27001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:00.574689 27001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:00.578555 27001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:00.578603 27001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:00.578657 27001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:57:00.583565 27001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:41289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:00.584419 27001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:00.585283 27001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:00.593957 27018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:00.593969 27014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:00.593997 27010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:00.594246 27001 server_base.cc:1034] running on GCE node
I20260808 15:57:00.594619 27001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:00.595188 27001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:00.596336 27001 hybrid_clock.cc:648] HybridClock initialized: now 1786204620596319 us; error 28 us; skew 500 ppm
Aug 08 15:57:00 dist-test-slave-lgr5 krb5kdc[26414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:00.601382 27001 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:57:00.602025 27001 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:00.602089 27001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:00.602265 27001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:00.604163 27001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "cefc79c782ac4dda8ca6f10fad480f48"
format_stamp: "Formatted at 2026-08-08 15:57:00 on dist-test-slave-lgr5"
server_key: "e0e4365f3da0a9c302c187a9a266854c"
server_key_iv: "c21e4e5c6c6450cd6b34f9881f3a7e20"
server_key_version: "encryptionkey@0"
I20260808 15:57:00.604681 27001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "cefc79c782ac4dda8ca6f10fad480f48"
format_stamp: "Formatted at 2026-08-08 15:57:00 on dist-test-slave-lgr5"
server_key: "e0e4365f3da0a9c302c187a9a266854c"
server_key_iv: "c21e4e5c6c6450cd6b34f9881f3a7e20"
server_key_version: "encryptionkey@0"
I20260808 15:57:00.607913 27001 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:57:00.610013 27028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:00.611091 27001 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:00.611207 27001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "cefc79c782ac4dda8ca6f10fad480f48"
format_stamp: "Formatted at 2026-08-08 15:57:00 on dist-test-slave-lgr5"
server_key: "e0e4365f3da0a9c302c187a9a266854c"
server_key_iv: "c21e4e5c6c6450cd6b34f9881f3a7e20"
server_key_version: "encryptionkey@0"
I20260808 15:57:00.611290 27001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:00.622303 27001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:00.624722 27001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:00.624888 27001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:00.625386 27001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:00.626128 27001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:00.626174 27001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:00.626223 27001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:00.626252 27001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:00.634325 27001 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:43615
I20260808 15:57:00.634378 27208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:43615 every 8 connection(s)
I20260808 15:57:00.634824 27001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:57:00.642078 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 27001
I20260808 15:57:00.642179 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:57:00.642482 19828 external_mini_cluster.cc:1428] Setting key cace1c75178a83e928ebad83884caf66
Aug 08 15:57:00 dist-test-slave-lgr5 krb5kdc[26414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:57:00.647291 26541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.636385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:50019 (local address 127.19.93.62:41289)
0808 15:57:00.636529 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:00.636533 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:00.637299 (+ 766us) server_negotiation.cc:407] Connection header received
0808 15:57:00.638541 (+ 1242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:00.638544 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:00.638592 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:00.638663 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:00.639697 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.640243 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.641285 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.641493 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.641561 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.644188 (+ 2627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:00.644192 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:00.644195 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:00.644219 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:00.645465 (+ 1246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:00.645923 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:00.645926 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:00.645928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:00.645999 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:00.646300 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:00.646303 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:00.646305 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:00.646475 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:00.646558 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:00.647016 (+ 458us) server_negotiation.cc:299] Negotiation successful
0808 15:57:00.647136 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 15:57:00.647965 27213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.636730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:41289 (local address 127.19.93.3:50019)
0808 15:57:00.637168 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:00.637206 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:00.638362 (+ 1156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:00.638803 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:00.638809 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:00.639142 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:00.639577 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:00.639591 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.640335 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.640338 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:00.641189 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:00.641199 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.641595 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.641597 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:00.641724 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.642354 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:00.642374 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:00.643994 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:00.645581 (+ 1587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:00.645587 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:00.645599 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:00.645828 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:00.646080 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:00.646083 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:00.646085 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:00.646212 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:00.646582 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:00.646588 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:00.646801 (+ 213us) client_negotiation.cc:769] Sending connection context
0808 15:57:00.646956 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 15:57:00.647239 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":109,"threads_started":1}
I20260808 15:57:00.648914 27210 heartbeater.cc:347] Connected to a master server at 127.19.93.62:41289
I20260808 15:57:00.649103 27210 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:00.649464 27210 heartbeater.cc:511] Master 127.19.93.62:41289 requested a full tablet report, sending...
I20260808 15:57:00.650398 26482 ts_manager.cc:194] Registered new tserver with Master: cefc79c782ac4dda8ca6f10fad480f48 (127.19.93.3:43615)
I20260808 15:57:00.650931 26482 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:50019
I20260808 15:57:00.656008 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:57:00.664022 26541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.657785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33460 (local address 127.19.93.62:41289)
0808 15:57:00.657895 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:00.657898 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:00.658073 (+ 175us) server_negotiation.cc:407] Connection header received
0808 15:57:00.658165 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:00.658167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:00.658200 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:00.658258 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:00.658837 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.659316 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.660174 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.660379 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.660455 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.661517 (+ 1062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:00.661520 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:00.661522 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:00.661543 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:00.662723 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:00.663081 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:00.663083 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:00.663084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:00.663145 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:00.663404 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:00.663406 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:00.663407 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:00.663584 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:00.663675 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:00.663836 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 15:57:00.663916 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 15:57:00.666370 26482 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33460:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:57:00.669211 26482 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:57:00.682789 27235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.677273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46950 (local address 127.19.93.1:32963)
0808 15:57:00.677698 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:00.677710 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:00.677734 (+ 24us) server_negotiation.cc:407] Connection header received
0808 15:57:00.677970 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:00.677976 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:00.678182 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:00.678330 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:00.678719 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.679780 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.681438 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.682137 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.682239 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.682389 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:00.682550 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 15:57:00.682646 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":110,"threads_started":1}
I20260808 15:57:00.682786 27234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.677114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:32963 (local address 127.0.0.1:46950)
0808 15:57:00.677595 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:00.677640 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:00.677758 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:00.678450 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:00.678456 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:00.678488 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:00.678616 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:00.678623 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.679916 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.679919 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:00.681294 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:00.681305 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.682260 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.682263 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:00.682368 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.682405 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 15:57:00.682506 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 15:57:00.682637 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":3,"spinlock_wait_cycles":384,"thread_start_us":73,"threads_started":1}
I20260808 15:57:00.683352 27232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.677258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:44227 (local address 127.0.0.1:43804)
0808 15:57:00.678393 (+ 1135us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:00.678406 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:00.678498 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:00.679174 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:00.679176 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:00.679191 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:00.679267 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:00.679273 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.680457 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.680460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:00.681644 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:00.681654 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.682864 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.682868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:00.683018 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.683079 (+ 61us) client_negotiation.cc:769] Sending connection context
0808 15:57:00.683152 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 15:57:00.683218 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1074,"mutex_wait_us":109,"spinlock_wait_cycles":5632,"thread_start_us":103,"threads_started":1}
I20260808 15:57:00.683447 27238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.677858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43804 (local address 127.19.93.2:44227)
0808 15:57:00.678351 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:00.678363 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:00.678613 (+ 250us) server_negotiation.cc:407] Connection header received
0808 15:57:00.678697 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:00.678701 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:00.678900 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:00.679031 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:00.679392 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.680318 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.681756 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.682568 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.682672 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.682800 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:00.683205 (+ 405us) server_negotiation.cc:299] Negotiation successful
0808 15:57:00.683303 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":96,"threads_started":1}
I20260808 15:57:00.683457 27240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.677963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56220 (local address 127.19.93.3:43615)
0808 15:57:00.678261 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:00.678272 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:00.678929 (+ 657us) server_negotiation.cc:407] Connection header received
0808 15:57:00.679011 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:00.679015 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:00.679182 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:00.679319 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:00.679509 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.680408 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.681806 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.682568 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.682672 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.682799 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:00.683214 (+ 415us) server_negotiation.cc:299] Negotiation successful
0808 15:57:00.683304 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":114,"threads_started":1}
I20260808 15:57:00.683754 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.677788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:43615 (local address 127.0.0.1:56220)
0808 15:57:00.678817 (+ 1029us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:00.678828 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:00.678913 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:00.679321 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:00.679324 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:00.679340 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:00.679421 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:00.679427 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.680525 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.680528 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:00.681660 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:00.681671 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.682864 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.682868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:00.683006 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.683079 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 15:57:00.683570 (+ 491us) client_negotiation.cc:240] Negotiation successful
0808 15:57:00.683635 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":970,"mutex_wait_us":43,"thread_start_us":113,"threads_started":1}
I20260808 15:57:00.686246 27102 tablet_service.cc:1467] Processing CreateTablet for tablet 2d6d91f1f61b42e7a4963bbfb2f4a2eb (DEFAULT_TABLE table=test-table [id=ef29cf7da4ef42aca14a0e983bb8aa34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:00.686249 26674 tablet_service.cc:1467] Processing CreateTablet for tablet 2d6d91f1f61b42e7a4963bbfb2f4a2eb (DEFAULT_TABLE table=test-table [id=ef29cf7da4ef42aca14a0e983bb8aa34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:00.686431 26885 tablet_service.cc:1467] Processing CreateTablet for tablet 2d6d91f1f61b42e7a4963bbfb2f4a2eb (DEFAULT_TABLE table=test-table [id=ef29cf7da4ef42aca14a0e983bb8aa34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:00.687189 27102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d6d91f1f61b42e7a4963bbfb2f4a2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:00.687286 26674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d6d91f1f61b42e7a4963bbfb2f4a2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:00.687286 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d6d91f1f61b42e7a4963bbfb2f4a2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:00.694047 27241 tablet_bootstrap.cc:492] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48: Bootstrap starting.
I20260808 15:57:00.695021 27244 tablet_bootstrap.cc:492] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173: Bootstrap starting.
I20260808 15:57:00.695021 27243 tablet_bootstrap.cc:492] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c: Bootstrap starting.
I20260808 15:57:00.696188 27241 tablet_bootstrap.cc:654] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:00.697132 27241 log.cc:824] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:00.697170 27243 tablet_bootstrap.cc:654] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:00.697486 27244 tablet_bootstrap.cc:654] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:00.698261 27244 log.cc:824] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:00.698261 27243 log.cc:824] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:00.698889 27241 tablet_bootstrap.cc:492] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48: No bootstrap required, opened a new log
I20260808 15:57:00.699079 27241 ts_tablet_manager.cc:1397] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260808 15:57:00.700246 27243 tablet_bootstrap.cc:492] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c: No bootstrap required, opened a new log
I20260808 15:57:00.700425 27243 ts_tablet_manager.cc:1397] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 15:57:00.700519 27244 tablet_bootstrap.cc:492] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173: No bootstrap required, opened a new log
I20260808 15:57:00.700703 27244 ts_tablet_manager.cc:1397] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 15:57:00.702795 27241 raft_consensus.cc:348] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa51c277aa16403d99f21568244fe09c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 32963 } } peers { permanent_uuid: "b254c63f7d984bdcb0850a77520c4173" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44227 } } peers { permanent_uuid: "cefc79c782ac4dda8ca6f10fad480f48" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43615 } }
I20260808 15:57:00.703080 27241 raft_consensus.cc:374] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:00.703173 27241 raft_consensus.cc:729] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cefc79c782ac4dda8ca6f10fad480f48, State: Initialized, Role: FOLLOWER
I20260808 15:57:00.703035 27243 raft_consensus.cc:348] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa51c277aa16403d99f21568244fe09c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 32963 } } peers { permanent_uuid: "b254c63f7d984bdcb0850a77520c4173" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44227 } } peers { permanent_uuid: "cefc79c782ac4dda8ca6f10fad480f48" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43615 } }
I20260808 15:57:00.703272 27243 raft_consensus.cc:374] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:00.703354 27243 raft_consensus.cc:729] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa51c277aa16403d99f21568244fe09c, State: Initialized, Role: FOLLOWER
I20260808 15:57:00.703625 27241 consensus_queue.cc:260] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa51c277aa16403d99f21568244fe09c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 32963 } } peers { permanent_uuid: "b254c63f7d984bdcb0850a77520c4173" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44227 } } peers { permanent_uuid: "cefc79c782ac4dda8ca6f10fad480f48" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43615 } }
I20260808 15:57:00.703764 27243 consensus_queue.cc:260] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa51c277aa16403d99f21568244fe09c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 32963 } } peers { permanent_uuid: "b254c63f7d984bdcb0850a77520c4173" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44227 } } peers { permanent_uuid: "cefc79c782ac4dda8ca6f10fad480f48" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43615 } }
I20260808 15:57:00.704306 27210 heartbeater.cc:503] Master 127.19.93.62:41289 was elected leader, sending a full tablet report...
I20260808 15:57:00.704229 27244 raft_consensus.cc:348] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa51c277aa16403d99f21568244fe09c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 32963 } } peers { permanent_uuid: "b254c63f7d984bdcb0850a77520c4173" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44227 } } peers { permanent_uuid: "cefc79c782ac4dda8ca6f10fad480f48" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43615 } }
I20260808 15:57:00.704465 27244 raft_consensus.cc:374] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:00.704519 27244 raft_consensus.cc:729] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b254c63f7d984bdcb0850a77520c4173, State: Initialized, Role: FOLLOWER
I20260808 15:57:00.704649 27241 ts_tablet_manager.cc:1428] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260808 15:57:00.704680 27243 ts_tablet_manager.cc:1428] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260808 15:57:00.704910 27244 consensus_queue.cc:260] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa51c277aa16403d99f21568244fe09c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 32963 } } peers { permanent_uuid: "b254c63f7d984bdcb0850a77520c4173" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44227 } } peers { permanent_uuid: "cefc79c782ac4dda8ca6f10fad480f48" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43615 } }
I20260808 15:57:00.705053 26782 heartbeater.cc:503] Master 127.19.93.62:41289 was elected leader, sending a full tablet report...
I20260808 15:57:00.706115 26992 heartbeater.cc:503] Master 127.19.93.62:41289 was elected leader, sending a full tablet report...
I20260808 15:57:00.706127 27244 ts_tablet_manager.cc:1428] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260808 15:57:00.735355 26785 tablet.cc:2369] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:57:00.785053 27251 raft_consensus.cc:482] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:57:00.785246 27251 raft_consensus.cc:504] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa51c277aa16403d99f21568244fe09c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 32963 } } peers { permanent_uuid: "b254c63f7d984bdcb0850a77520c4173" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44227 } } peers { permanent_uuid: "cefc79c782ac4dda8ca6f10fad480f48" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43615 } }
I20260808 15:57:00.786360 27251 leader_election.cc:288] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b254c63f7d984bdcb0850a77520c4173 (127.19.93.2:44227), cefc79c782ac4dda8ca6f10fad480f48 (127.19.93.3:43615)
I20260808 15:57:00.790297 27240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.786764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:37197 (local address 127.19.93.3:43615)
0808 15:57:00.786896 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:00.786900 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:00.787072 (+ 172us) server_negotiation.cc:407] Connection header received
0808 15:57:00.787197 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:00.787200 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:00.787243 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:00.787300 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:00.787605 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.788121 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.789366 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.789755 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.789847 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.789913 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:00.790101 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 15:57:00.790173 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:57:00.790297 27238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.786698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:45479 (local address 127.19.93.2:44227)
0808 15:57:00.786848 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:00.786854 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:00.787055 (+ 201us) server_negotiation.cc:407] Connection header received
0808 15:57:00.787212 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:00.787214 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:00.787259 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:00.787326 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:00.787629 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.788181 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.789325 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.789787 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.789896 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.789989 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:00.790122 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 15:57:00.790193 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 15:57:00.790314 27255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.786616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:43615 (local address 127.19.93.1:37197)
0808 15:57:00.786971 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:00.786982 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:00.787105 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:00.787326 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:00.787329 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:00.787345 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:00.787495 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:00.787501 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.788236 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.788240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:00.789240 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:00.789250 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.789876 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.789880 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:00.789976 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.790000 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:57:00.790079 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 15:57:00.790153 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":48,"spinlock_wait_cycles":6144,"thread_start_us":122,"threads_started":1}
I20260808 15:57:00.790891 27257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.786588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:44227 (local address 127.19.93.1:45479)
0808 15:57:00.786956 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:00.786970 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:00.787105 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:00.787349 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:00.787352 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:00.787369 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:00.787514 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:00.787519 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.788289 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.788291 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:00.789213 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:00.789222 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.789894 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.789898 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:00.790004 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.790027 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:57:00.790098 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 15:57:00.790177 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":22,"spinlock_wait_cycles":42112,"thread_start_us":107,"threads_started":1}
I20260808 15:57:00.791057 27142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d6d91f1f61b42e7a4963bbfb2f4a2eb" candidate_uuid: "fa51c277aa16403d99f21568244fe09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cefc79c782ac4dda8ca6f10fad480f48" is_pre_election: true
I20260808 15:57:00.791388 27142 raft_consensus.cc:2454] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa51c277aa16403d99f21568244fe09c in term 0.
I20260808 15:57:00.791502 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d6d91f1f61b42e7a4963bbfb2f4a2eb" candidate_uuid: "fa51c277aa16403d99f21568244fe09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b254c63f7d984bdcb0850a77520c4173" is_pre_election: true
I20260808 15:57:00.791818 26912 raft_consensus.cc:2454] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa51c277aa16403d99f21568244fe09c in term 0.
I20260808 15:57:00.791857 26604 leader_election.cc:302] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cefc79c782ac4dda8ca6f10fad480f48, fa51c277aa16403d99f21568244fe09c; no voters:
I20260808 15:57:00.792186 27251 raft_consensus.cc:2781] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:57:00.792284 27251 raft_consensus.cc:482] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:57:00.792337 27251 raft_consensus.cc:3037] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:00.793344 27251 raft_consensus.cc:504] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa51c277aa16403d99f21568244fe09c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 32963 } } peers { permanent_uuid: "b254c63f7d984bdcb0850a77520c4173" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44227 } } peers { permanent_uuid: "cefc79c782ac4dda8ca6f10fad480f48" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43615 } }
I20260808 15:57:00.793668 27251 leader_election.cc:288] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [CANDIDATE]: Term 1 election: Requested vote from peers b254c63f7d984bdcb0850a77520c4173 (127.19.93.2:44227), cefc79c782ac4dda8ca6f10fad480f48 (127.19.93.3:43615)
I20260808 15:57:00.794003 27142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d6d91f1f61b42e7a4963bbfb2f4a2eb" candidate_uuid: "fa51c277aa16403d99f21568244fe09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cefc79c782ac4dda8ca6f10fad480f48"
I20260808 15:57:00.794129 27142 raft_consensus.cc:3037] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:00.795189 27142 raft_consensus.cc:2454] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa51c277aa16403d99f21568244fe09c in term 1.
I20260808 15:57:00.795471 26604 leader_election.cc:302] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cefc79c782ac4dda8ca6f10fad480f48, fa51c277aa16403d99f21568244fe09c; no voters:
I20260808 15:57:00.795485 26912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d6d91f1f61b42e7a4963bbfb2f4a2eb" candidate_uuid: "fa51c277aa16403d99f21568244fe09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b254c63f7d984bdcb0850a77520c4173"
I20260808 15:57:00.795588 26912 raft_consensus.cc:3037] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:00.795665 27251 raft_consensus.cc:2781] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:00.795863 27251 raft_consensus.cc:686] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [term 1 LEADER]: Becoming Leader. State: Replica: fa51c277aa16403d99f21568244fe09c, State: Running, Role: LEADER
I20260808 15:57:00.796229 27251 consensus_queue.cc:237] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa51c277aa16403d99f21568244fe09c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 32963 } } peers { permanent_uuid: "b254c63f7d984bdcb0850a77520c4173" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44227 } } peers { permanent_uuid: "cefc79c782ac4dda8ca6f10fad480f48" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43615 } }
I20260808 15:57:00.796854 26912 raft_consensus.cc:2454] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa51c277aa16403d99f21568244fe09c in term 1.
I20260808 15:57:00.799290 26482 catalog_manager.cc:5495] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c reported cstate change: term changed from 0 to 1, leader changed from <none> to fa51c277aa16403d99f21568244fe09c (127.19.93.1). New cstate: current_term: 1 leader_uuid: "fa51c277aa16403d99f21568244fe09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa51c277aa16403d99f21568244fe09c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b254c63f7d984bdcb0850a77520c4173" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cefc79c782ac4dda8ca6f10fad480f48" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43615 } health_report { overall_health: UNKNOWN } } }
I20260808 15:57:00.831264 27235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.828152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46952 (local address 127.19.93.1:32963)
0808 15:57:00.828273 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:00.828277 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:00.828290 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:57:00.828425 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:00.828427 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:00.828479 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:00.828569 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:57:00.828753 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.829223 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.830041 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:00.830239 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:00.830306 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:00.830565 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:57:00.830967 (+ 402us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:57:00.831054 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:00.831088 (+ 34us) server_negotiation.cc:299] Negotiation successful
0808 15:57:00.831133 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 15:57:00.836683 26912 raft_consensus.cc:1261] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173 [term 1 FOLLOWER]: Refusing update from remote peer fa51c277aa16403d99f21568244fe09c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:00.836683 27142 raft_consensus.cc:1261] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48 [term 1 FOLLOWER]: Refusing update from remote peer fa51c277aa16403d99f21568244fe09c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:00.837354 27251 consensus_queue.cc:1035] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cefc79c782ac4dda8ca6f10fad480f48" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:00.837532 27258 consensus_queue.cc:1035] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P fa51c277aa16403d99f21568244fe09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b254c63f7d984bdcb0850a77520c4173" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:00.845158 27268 mvcc.cc:205] Tried to move back new op lower bound from 7316294126940504064 to 7316294126784483328. Current Snapshot: MvccSnapshot[applied={T|T < 7316294126940504064}]
I20260808 15:57:00.853403 26481 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:00.853581 26481 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:00.856027 26481 catalog_manager.cc:5782] T 00000000000000000000000000000000 P acf9638d63004fbd9f74ee2798b59ac6: Sending DeleteTablet for 3 replicas of tablet 2d6d91f1f61b42e7a4963bbfb2f4a2eb
I20260808 15:57:00.856768 26885 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d6d91f1f61b42e7a4963bbfb2f4a2eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:00 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:43804
I20260808 15:57:00.856835 26674 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d6d91f1f61b42e7a4963bbfb2f4a2eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:00 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:46950
I20260808 15:57:00.856849 27102 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d6d91f1f61b42e7a4963bbfb2f4a2eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:00 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:56220
I20260808 15:57:00.857365 27279 tablet_replica.cc:330] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173: stopping tablet replica
I20260808 15:57:00.857390 27280 tablet_replica.cc:330] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48: stopping tablet replica
I20260808 15:57:00.857686 27279 raft_consensus.cc:2229] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:00.857728 27280 raft_consensus.cc:2229] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:00.858031 27280 raft_consensus.cc:2258] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:00.858129 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 26575
I20260808 15:57:00.858000 27279 raft_consensus.cc:2258] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:00.862377 27279 ts_tablet_manager.cc:1905] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:00.863478 27280 ts_tablet_manager.cc:1905] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:00.865492 27280 ts_tablet_manager.cc:1918] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:00.865561 27280 log.cc:1196] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/2d6d91f1f61b42e7a4963bbfb2f4a2eb
I20260808 15:57:00.865772 27280 ts_tablet_manager.cc:1939] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P cefc79c782ac4dda8ca6f10fad480f48: Deleting consensus metadata
I20260808 15:57:00.865763 27279 ts_tablet_manager.cc:1918] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:00.865881 27279 log.cc:1196] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/2d6d91f1f61b42e7a4963bbfb2f4a2eb
I20260808 15:57:00.866303 27279 ts_tablet_manager.cc:1939] T 2d6d91f1f61b42e7a4963bbfb2f4a2eb P b254c63f7d984bdcb0850a77520c4173: Deleting consensus metadata
I20260808 15:57:00.866736 26460 catalog_manager.cc:4841] TS cefc79c782ac4dda8ca6f10fad480f48 (127.19.93.3:43615): tablet 2d6d91f1f61b42e7a4963bbfb2f4a2eb (table test-table [id=ef29cf7da4ef42aca14a0e983bb8aa34]) successfully deleted
I20260808 15:57:00.867453 26459 catalog_manager.cc:4841] TS b254c63f7d984bdcb0850a77520c4173 (127.19.93.2:44227): tablet 2d6d91f1f61b42e7a4963bbfb2f4a2eb (table test-table [id=ef29cf7da4ef42aca14a0e983bb8aa34]) successfully deleted
W20260808 15:57:00.874276 26460 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:32963 (error 108)
I20260808 15:57:00.874522 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 26791
I20260808 15:57:00.880002 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:00.879681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:32963 (local address 127.0.0.1:46962)
0808 15:57:00.879824 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:00.879908 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:32963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 15:57:00.880192 26460 catalog_manager.cc:4584] TS fa51c277aa16403d99f21568244fe09c (127.19.93.1:32963): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2d6d91f1f61b42e7a4963bbfb2f4a2eb: Network error: Client connection negotiation failed: client connection to 127.19.93.1:32963: connect: Connection refused (error 111)
I20260808 15:57:00.884202 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 27001
I20260808 15:57:00.893914 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 26432
2026-08-08T15:57:00Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2385 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T15:57:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:57:00Z Disabled control of system clock
I20260808 15:57:00.927464 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:32897
--webserver_interface=127.19.93.62
--webserver_port=0
--builtin_ntp_servers=127.19.93.20:42659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:32897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 15:57:01.035647 27289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:01.035867 27289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:01.035900 27289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:01.039762 27289 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:57:01.039810 27289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:01.039824 27289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:01.039839 27289 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:57:01.039851 27289 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:57:01.044435 27289 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:42659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:32897
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:32897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:01.045327 27289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:01.046562 27289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:01.054411 27297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:01.054430 27296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:01.054459 27289 server_base.cc:1034] running on GCE node
W20260808 15:57:01.054399 27300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:01.055104 27289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:01.056114 27289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:01.057272 27289 hybrid_clock.cc:648] HybridClock initialized: now 1786204621057251 us; error 37 us; skew 500 ppm
I20260808 15:57:01.059017 27289 webserver.cc:460] Webserver started at http://127.19.93.62:39139/ using document root <none> and password file <none>
I20260808 15:57:01.059521 27289 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:01.059595 27289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:01.059775 27289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:01.061721 27289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "766aac881b284ff8810a06977f065319"
format_stamp: "Formatted at 2026-08-08 15:57:01 on dist-test-slave-lgr5"
server_key: "16e8f47da52cf315d88b0917a426ea67"
server_key_iv: "afc0b821ae08163aaee6b762df37ddbf"
server_key_version: "encryptionkey@0"
I20260808 15:57:01.062237 27289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "766aac881b284ff8810a06977f065319"
format_stamp: "Formatted at 2026-08-08 15:57:01 on dist-test-slave-lgr5"
server_key: "16e8f47da52cf315d88b0917a426ea67"
server_key_iv: "afc0b821ae08163aaee6b762df37ddbf"
server_key_version: "encryptionkey@0"
I20260808 15:57:01.065516 27289 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260808 15:57:01.067636 27310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:01.068739 27289 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260808 15:57:01.068858 27289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "766aac881b284ff8810a06977f065319"
format_stamp: "Formatted at 2026-08-08 15:57:01 on dist-test-slave-lgr5"
server_key: "16e8f47da52cf315d88b0917a426ea67"
server_key_iv: "afc0b821ae08163aaee6b762df37ddbf"
server_key_version: "encryptionkey@0"
I20260808 15:57:01.068948 27289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:01.073078 27289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:01.073611 27289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:01.073757 27289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:01.080018 27289 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:32897
I20260808 15:57:01.080035 27394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:32897 every 8 connection(s)
I20260808 15:57:01.080842 27289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:57:01.082435 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 27289
I20260808 15:57:01.082543 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:57:01.082777 19828 external_mini_cluster.cc:1428] Setting key 3cc2de578f06d93ff2a1233d8e0cc04d
I20260808 15:57:01.084267 27396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:01.088017 27400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.084301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42850 (local address 127.19.93.62:32897)
0808 15:57:01.084884 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:01.084899 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:01.084933 (+ 34us) server_negotiation.cc:407] Connection header received
0808 15:57:01.085536 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:01.085554 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:01.085865 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:01.086130 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:01.086896 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:01.086900 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:01.086911 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:01.086920 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:01.086970 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:01.086985 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:01.087089 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:01.087179 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 15:57:01.087382 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":114,"threads_started":1}
I20260808 15:57:01.089986 27396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319: Bootstrap starting.
I20260808 15:57:01.092119 27396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:01.092818 27396 log.cc:824] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:01.094448 27396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319: No bootstrap required, opened a new log
I20260808 15:57:01.097714 27396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "766aac881b284ff8810a06977f065319" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 32897 } }
I20260808 15:57:01.097906 27396 raft_consensus.cc:374] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:01.097973 27396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766aac881b284ff8810a06977f065319, State: Initialized, Role: FOLLOWER
I20260808 15:57:01.098346 27396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "766aac881b284ff8810a06977f065319" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 32897 } }
I20260808 15:57:01.098469 27396 raft_consensus.cc:388] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:57:01.098531 27396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:57:01.098624 27396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:01.099366 27396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "766aac881b284ff8810a06977f065319" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 32897 } }
I20260808 15:57:01.099658 27396 leader_election.cc:302] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 766aac881b284ff8810a06977f065319; no voters:
I20260808 15:57:01.099925 27396 leader_election.cc:288] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:57:01.100006 27402 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:01.100247 27402 raft_consensus.cc:686] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [term 1 LEADER]: Becoming Leader. State: Replica: 766aac881b284ff8810a06977f065319, State: Running, Role: LEADER
I20260808 15:57:01.100535 27402 consensus_queue.cc:237] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "766aac881b284ff8810a06977f065319" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 32897 } }
I20260808 15:57:01.100998 27396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:57:01.101909 27403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "766aac881b284ff8810a06977f065319" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "766aac881b284ff8810a06977f065319" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 32897 } } }
I20260808 15:57:01.102039 27403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:01.102332 27409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 766aac881b284ff8810a06977f065319. Latest consensus state: current_term: 1 leader_uuid: "766aac881b284ff8810a06977f065319" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "766aac881b284ff8810a06977f065319" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 32897 } } }
I20260808 15:57:01.102425 27409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:01.102530 27416 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:57:01.105690 27416 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:57:01.110637 27416 catalog_manager.cc:1347] Generated new cluster ID: 2f45652b327b460f8e6c93941122324c
I20260808 15:57:01.110687 27416 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:57:01.128551 27416 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:57:01.128829 27416 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:57:01.138303 27416 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319: Generated new TSK 0
I20260808 15:57:01.139008 27416 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:57:01.146138 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:32897
--builtin_ntp_servers=127.19.93.20:42659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 15:57:01.254410 27433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:01.254634 27433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:01.254669 27433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:01.258526 27433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:01.258579 27433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:01.258633 27433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:57:01.263266 27433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:42659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:32897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:01.264209 27433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:01.265462 27433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:01.274827 27444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:01.274853 27447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:01.274832 27443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:01.275137 27433 server_base.cc:1034] running on GCE node
I20260808 15:57:01.275489 27433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:01.276014 27433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:01.277163 27433 hybrid_clock.cc:648] HybridClock initialized: now 1786204621277139 us; error 36 us; skew 500 ppm
I20260808 15:57:01.278856 27433 webserver.cc:460] Webserver started at http://127.19.93.1:42773/ using document root <none> and password file <none>
I20260808 15:57:01.279371 27433 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:01.279428 27433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:01.279613 27433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:01.281553 27433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "5805dfc51ef14c8ba35dceab65b9aa4c"
format_stamp: "Formatted at 2026-08-08 15:57:01 on dist-test-slave-lgr5"
server_key: "385dc4bb460d75da6908a3cf83dbde7f"
server_key_iv: "c4f77d5bab95841f95c52a36cf6e35eb"
server_key_version: "encryptionkey@0"
I20260808 15:57:01.282092 27433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "5805dfc51ef14c8ba35dceab65b9aa4c"
format_stamp: "Formatted at 2026-08-08 15:57:01 on dist-test-slave-lgr5"
server_key: "385dc4bb460d75da6908a3cf83dbde7f"
server_key_iv: "c4f77d5bab95841f95c52a36cf6e35eb"
server_key_version: "encryptionkey@0"
I20260808 15:57:01.285426 27433 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260808 15:57:01.287647 27458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:01.288797 27433 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 15:57:01.288914 27433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "5805dfc51ef14c8ba35dceab65b9aa4c"
format_stamp: "Formatted at 2026-08-08 15:57:01 on dist-test-slave-lgr5"
server_key: "385dc4bb460d75da6908a3cf83dbde7f"
server_key_iv: "c4f77d5bab95841f95c52a36cf6e35eb"
server_key_version: "encryptionkey@0"
I20260808 15:57:01.289007 27433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:01.293241 27433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:01.293778 27433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:01.293923 27433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:01.294400 27433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:01.295258 27433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:01.295305 27433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:01.295354 27433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:01.295379 27433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:01.303567 27433 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:40239
I20260808 15:57:01.303622 27646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:40239 every 8 connection(s)
I20260808 15:57:01.304435 27433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:57:01.310225 27400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.306146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:54337 (local address 127.19.93.62:32897)
0808 15:57:01.306287 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:01.306291 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:01.307249 (+ 958us) server_negotiation.cc:407] Connection header received
0808 15:57:01.308665 (+ 1416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:01.308669 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:01.308714 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:01.308789 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:01.309793 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:01.309797 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:01.309800 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:01.309813 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:01.309833 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:01.309842 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:01.309928 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:01.310043 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 15:57:01.310089 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:57:01.311019 27652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.306483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:32897 (local address 127.19.93.1:54337)
0808 15:57:01.307115 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:01.307152 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:01.308467 (+ 1315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:01.308956 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:01.308962 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:01.309046 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:01.309544 (+ 498us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:57:01.309546 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:01.309584 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:57:01.309651 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:01.309913 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:01.309921 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:01.309927 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:57:01.310086 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 15:57:01.310317 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":112,"threads_started":1}
I20260808 15:57:01.312107 27647 heartbeater.cc:347] Connected to a master server at 127.19.93.62:32897
I20260808 15:57:01.312309 27647 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:01.312489 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 27433
I20260808 15:57:01.312616 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:57:01.312760 27647 heartbeater.cc:511] Master 127.19.93.62:32897 requested a full tablet report, sending...
I20260808 15:57:01.312938 19828 external_mini_cluster.cc:1428] Setting key 1277ee916c275ff0432289e5a9f1f455
I20260808 15:57:01.314316 27342 ts_manager.cc:194] Registered new tserver with Master: 5805dfc51ef14c8ba35dceab65b9aa4c (127.19.93.1:40239)
I20260808 15:57:01.315251 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:32897
--builtin_ntp_servers=127.19.93.20:42659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 15:57:01.423147 27653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:01.423385 27653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:01.423422 27653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:01.427299 27653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:01.427346 27653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:01.427397 27653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:57:01.431908 27653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:42659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:32897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:01.432881 27653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:01.434144 27653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:01.443217 27667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:01.443217 27663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:01.443289 27662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:01.443382 27653 server_base.cc:1034] running on GCE node
I20260808 15:57:01.443867 27653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:01.444449 27653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:01.445600 27653 hybrid_clock.cc:648] HybridClock initialized: now 1786204621445576 us; error 35 us; skew 500 ppm
I20260808 15:57:01.447232 27653 webserver.cc:460] Webserver started at http://127.19.93.2:39109/ using document root <none> and password file <none>
I20260808 15:57:01.447741 27653 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:01.447798 27653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:01.448009 27653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:01.449950 27653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "db17366ca1824be483d75ae442f7cdfe"
format_stamp: "Formatted at 2026-08-08 15:57:01 on dist-test-slave-lgr5"
server_key: "0f51a039f80e16962ca5ab797381b905"
server_key_iv: "f6c08f94ca7b6e4a4b0e6d493e0fcffd"
server_key_version: "encryptionkey@0"
I20260808 15:57:01.450467 27653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "db17366ca1824be483d75ae442f7cdfe"
format_stamp: "Formatted at 2026-08-08 15:57:01 on dist-test-slave-lgr5"
server_key: "0f51a039f80e16962ca5ab797381b905"
server_key_iv: "f6c08f94ca7b6e4a4b0e6d493e0fcffd"
server_key_version: "encryptionkey@0"
I20260808 15:57:01.453971 27653 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:57:01.456257 27677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:01.457331 27653 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:57:01.457439 27653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "db17366ca1824be483d75ae442f7cdfe"
format_stamp: "Formatted at 2026-08-08 15:57:01 on dist-test-slave-lgr5"
server_key: "0f51a039f80e16962ca5ab797381b905"
server_key_iv: "f6c08f94ca7b6e4a4b0e6d493e0fcffd"
server_key_version: "encryptionkey@0"
I20260808 15:57:01.457532 27653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:01.461810 27653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:01.462349 27653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:01.462491 27653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:01.462980 27653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:01.463789 27653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:01.463841 27653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:01.463897 27653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:01.463923 27653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:01.471863 27653 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:36905
I20260808 15:57:01.471881 27864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:36905 every 8 connection(s)
I20260808 15:57:01.472668 27653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:57:01.478085 27400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.474242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:54783 (local address 127.19.93.62:32897)
0808 15:57:01.474435 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:01.474440 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:01.475358 (+ 918us) server_negotiation.cc:407] Connection header received
0808 15:57:01.476629 (+ 1271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:01.476633 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:01.476671 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:01.476749 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:01.477719 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:01.477722 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:01.477725 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:01.477736 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:01.477756 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:01.477764 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:01.477841 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:01.477931 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 15:57:01.477977 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 15:57:01.478816 27871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.474608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:32897 (local address 127.19.93.2:54783)
0808 15:57:01.475221 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:01.475258 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:01.476415 (+ 1157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:01.476880 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:01.476886 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:01.476965 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:01.477473 (+ 508us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:57:01.477474 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:01.477512 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:57:01.477580 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:01.477835 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:01.477840 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:01.477843 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 15:57:01.477957 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 15:57:01.478151 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":102,"threads_started":1}
I20260808 15:57:01.479779 27868 heartbeater.cc:347] Connected to a master server at 127.19.93.62:32897
I20260808 15:57:01.479972 27868 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:01.480381 27868 heartbeater.cc:511] Master 127.19.93.62:32897 requested a full tablet report, sending...
I20260808 15:57:01.481298 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 27653
I20260808 15:57:01.481384 27342 ts_manager.cc:194] Registered new tserver with Master: db17366ca1824be483d75ae442f7cdfe (127.19.93.2:36905)
I20260808 15:57:01.481436 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:57:01.481685 19828 external_mini_cluster.cc:1428] Setting key 257b8a13d2243cbc068f815359ab932f
I20260808 15:57:01.483448 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:32897
--builtin_ntp_servers=127.19.93.20:42659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 15:57:01.591277 27875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:01.591501 27875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:01.591538 27875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:01.595450 27875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:01.595496 27875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:01.595556 27875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:57:01.600049 27875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:42659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:32897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:01.601032 27875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:01.602357 27875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:01.611449 27882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:01.611469 27886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:01.611439 27883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:01.611480 27875 server_base.cc:1034] running on GCE node
I20260808 15:57:01.612063 27875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:01.612660 27875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:01.613807 27875 hybrid_clock.cc:648] HybridClock initialized: now 1786204621613785 us; error 34 us; skew 500 ppm
I20260808 15:57:01.615509 27875 webserver.cc:460] Webserver started at http://127.19.93.3:46383/ using document root <none> and password file <none>
I20260808 15:57:01.616026 27875 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:01.616117 27875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:01.616317 27875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:01.618232 27875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "10bbb740e1a147d5bb3566d0a05eaf8f"
format_stamp: "Formatted at 2026-08-08 15:57:01 on dist-test-slave-lgr5"
server_key: "b02af782a1dd76a8a9d1cea308a84987"
server_key_iv: "e78b9d77ef2098a83cb30d08c8adad38"
server_key_version: "encryptionkey@0"
I20260808 15:57:01.618781 27875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "10bbb740e1a147d5bb3566d0a05eaf8f"
format_stamp: "Formatted at 2026-08-08 15:57:01 on dist-test-slave-lgr5"
server_key: "b02af782a1dd76a8a9d1cea308a84987"
server_key_iv: "e78b9d77ef2098a83cb30d08c8adad38"
server_key_version: "encryptionkey@0"
I20260808 15:57:01.622112 27875 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:57:01.624330 27896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:01.625411 27875 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 15:57:01.625505 27875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "10bbb740e1a147d5bb3566d0a05eaf8f"
format_stamp: "Formatted at 2026-08-08 15:57:01 on dist-test-slave-lgr5"
server_key: "b02af782a1dd76a8a9d1cea308a84987"
server_key_iv: "e78b9d77ef2098a83cb30d08c8adad38"
server_key_version: "encryptionkey@0"
I20260808 15:57:01.625607 27875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:01.629797 27875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:01.630321 27875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:01.630467 27875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:01.630952 27875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:01.631789 27875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:01.631834 27875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:01.631875 27875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:01.631903 27875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:01.639954 27875 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:42449
I20260808 15:57:01.640009 28088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:42449 every 8 connection(s)
I20260808 15:57:01.640758 27875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:57:01.646112 27400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.642320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:51291 (local address 127.19.93.62:32897)
0808 15:57:01.642439 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:01.642442 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:01.643383 (+ 941us) server_negotiation.cc:407] Connection header received
0808 15:57:01.644620 (+ 1237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:01.644623 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:01.644667 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:01.644740 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:01.645689 (+ 949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:01.645693 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:01.645695 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:01.645707 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:01.645728 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:01.645735 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:01.645810 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:01.645939 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 15:57:01.645982 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 15:57:01.646831 28091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.642655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:32897 (local address 127.19.93.3:51291)
0808 15:57:01.643241 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:01.643279 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:01.644430 (+ 1151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:01.644906 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:01.644913 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:01.644992 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:01.645445 (+ 453us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:57:01.645446 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:01.645480 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:57:01.645543 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:01.645802 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:01.645810 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:01.645816 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:57:01.645971 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 15:57:01.646190 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":112,"threads_started":1}
I20260808 15:57:01.647825 28089 heartbeater.cc:347] Connected to a master server at 127.19.93.62:32897
I20260808 15:57:01.648005 28089 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:01.648360 28089 heartbeater.cc:511] Master 127.19.93.62:32897 requested a full tablet report, sending...
I20260808 15:57:01.649245 27342 ts_manager.cc:194] Registered new tserver with Master: 10bbb740e1a147d5bb3566d0a05eaf8f (127.19.93.3:42449)
I20260808 15:57:01.649266 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 27875
I20260808 15:57:01.649380 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:57:01.649633 19828 external_mini_cluster.cc:1428] Setting key 9a00dda88bf75c8283fbe489228263ad
I20260808 15:57:01.651480 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:57:01.654469 27400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.653187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42864 (local address 127.19.93.62:32897)
0808 15:57:01.653274 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:01.653277 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:01.653456 (+ 179us) server_negotiation.cc:407] Connection header received
0808 15:57:01.653550 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:01.653552 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:01.653578 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:01.653635 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:01.654214 (+ 579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:01.654216 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:01.654218 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:01.654227 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:01.654240 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:01.654246 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:01.654303 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:01.654359 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 15:57:01.654387 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 15:57:01.656839 27342 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42864:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:57:01.659628 27342 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:57:01.670440 28104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.667264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:36905 (local address 127.0.0.1:41810)
0808 15:57:01.667892 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:01.667904 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:01.667971 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:01.669019 (+ 1048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:01.669021 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:01.669033 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:01.669654 (+ 621us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:57:01.669657 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:01.669676 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:57:01.669742 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:01.670089 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:01.670098 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:01.670103 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 15:57:01.670206 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 15:57:01.670280 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"mutex_wait_us":2,"thread_start_us":108,"threads_started":1}
I20260808 15:57:01.670467 28108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.667950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44294 (local address 127.19.93.1:40239)
0808 15:57:01.668478 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:01.668493 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:01.668516 (+ 23us) server_negotiation.cc:407] Connection header received
0808 15:57:01.668567 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:01.668573 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:01.668750 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:01.668936 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:01.669988 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:01.669994 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:01.670005 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:01.670017 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:01.670058 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:01.670090 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:01.670197 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:01.670256 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 15:57:01.670323 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":142,"threads_started":1}
I20260808 15:57:01.670539 28113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.667977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41810 (local address 127.19.93.2:36905)
0808 15:57:01.668408 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:01.668426 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:01.668450 (+ 24us) server_negotiation.cc:407] Connection header received
0808 15:57:01.668695 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:01.668700 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:01.668875 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:01.669266 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:01.669919 (+ 653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:01.669925 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:01.669936 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:01.669947 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:01.669984 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:01.670008 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:01.670102 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:01.670343 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 15:57:01.670407 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":136,"threads_started":1}
I20260808 15:57:01.670449 28102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.667117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:42449 (local address 127.0.0.1:49048)
0808 15:57:01.667576 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:01.667619 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:01.667709 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:01.668939 (+ 1230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:01.668944 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:01.669011 (+ 67us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:01.669676 (+ 665us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:57:01.669678 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:01.669685 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:57:01.669742 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:01.670218 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:01.670221 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:01.670224 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 15:57:01.670278 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 15:57:01.670312 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":61,"threads_started":1}
I20260808 15:57:01.670923 28106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.667504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:40239 (local address 127.0.0.1:44294)
0808 15:57:01.668146 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:01.668159 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:01.668223 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:01.668943 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:01.668947 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:01.669012 (+ 65us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:01.669817 (+ 805us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:57:01.669819 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:01.669830 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:57:01.669858 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:01.670176 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:01.670180 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:01.670183 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 15:57:01.670232 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 15:57:01.670273 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":107,"threads_started":1}
I20260808 15:57:01.671780 28114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.667864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49048 (local address 127.19.93.3:42449)
0808 15:57:01.668570 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:01.668579 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:01.668596 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:57:01.668633 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:01.668654 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:01.668778 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:01.669261 (+ 483us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:01.670048 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:01.670053 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:01.670060 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:01.670069 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:01.670099 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:01.670119 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:01.671561 (+ 1442us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:01.671610 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 15:57:01.671676 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":467,"threads_started":1}
I20260808 15:57:01.673856 27972 tablet_service.cc:1467] Processing CreateTablet for tablet 6ed90754bfe341de9564e68d180b7012 (DEFAULT_TABLE table=test-table [id=129759cf4bbd432badebf92a3c14263a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:01.673753 27750 tablet_service.cc:1467] Processing CreateTablet for tablet 6ed90754bfe341de9564e68d180b7012 (DEFAULT_TABLE table=test-table [id=129759cf4bbd432badebf92a3c14263a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:01.673753 27542 tablet_service.cc:1467] Processing CreateTablet for tablet 6ed90754bfe341de9564e68d180b7012 (DEFAULT_TABLE table=test-table [id=129759cf4bbd432badebf92a3c14263a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:01.674733 27972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ed90754bfe341de9564e68d180b7012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:01.674750 27750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ed90754bfe341de9564e68d180b7012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:01.674750 27542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ed90754bfe341de9564e68d180b7012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:01.680564 28115 tablet_bootstrap.cc:492] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f: Bootstrap starting.
I20260808 15:57:01.682032 28116 tablet_bootstrap.cc:492] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe: Bootstrap starting.
I20260808 15:57:01.682032 28117 tablet_bootstrap.cc:492] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c: Bootstrap starting.
I20260808 15:57:01.682814 28115 tablet_bootstrap.cc:654] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:01.683946 28115 log.cc:824] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:01.684060 28117 tablet_bootstrap.cc:654] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:01.684067 28116 tablet_bootstrap.cc:654] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:01.684904 28117 log.cc:824] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:01.684901 28116 log.cc:824] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:01.685737 28115 tablet_bootstrap.cc:492] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f: No bootstrap required, opened a new log
I20260808 15:57:01.685928 28115 ts_tablet_manager.cc:1397] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:57:01.686700 28117 tablet_bootstrap.cc:492] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c: No bootstrap required, opened a new log
I20260808 15:57:01.686875 28117 ts_tablet_manager.cc:1397] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260808 15:57:01.687294 28116 tablet_bootstrap.cc:492] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe: No bootstrap required, opened a new log
I20260808 15:57:01.687495 28116 ts_tablet_manager.cc:1397] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260808 15:57:01.689203 28115 raft_consensus.cc:348] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10bbb740e1a147d5bb3566d0a05eaf8f" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42449 } } peers { permanent_uuid: "db17366ca1824be483d75ae442f7cdfe" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36905 } } peers { permanent_uuid: "5805dfc51ef14c8ba35dceab65b9aa4c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40239 } }
I20260808 15:57:01.689474 28115 raft_consensus.cc:374] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:01.689522 28115 raft_consensus.cc:729] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10bbb740e1a147d5bb3566d0a05eaf8f, State: Initialized, Role: FOLLOWER
I20260808 15:57:01.689864 28115 consensus_queue.cc:260] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10bbb740e1a147d5bb3566d0a05eaf8f" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42449 } } peers { permanent_uuid: "db17366ca1824be483d75ae442f7cdfe" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36905 } } peers { permanent_uuid: "5805dfc51ef14c8ba35dceab65b9aa4c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40239 } }
I20260808 15:57:01.690405 28089 heartbeater.cc:503] Master 127.19.93.62:32897 was elected leader, sending a full tablet report...
I20260808 15:57:01.690757 28115 ts_tablet_manager.cc:1428] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 15:57:01.691107 28117 raft_consensus.cc:348] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10bbb740e1a147d5bb3566d0a05eaf8f" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42449 } } peers { permanent_uuid: "db17366ca1824be483d75ae442f7cdfe" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36905 } } peers { permanent_uuid: "5805dfc51ef14c8ba35dceab65b9aa4c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40239 } }
I20260808 15:57:01.691344 28117 raft_consensus.cc:374] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:01.691397 28117 raft_consensus.cc:729] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5805dfc51ef14c8ba35dceab65b9aa4c, State: Initialized, Role: FOLLOWER
I20260808 15:57:01.691845 28117 consensus_queue.cc:260] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10bbb740e1a147d5bb3566d0a05eaf8f" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42449 } } peers { permanent_uuid: "db17366ca1824be483d75ae442f7cdfe" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36905 } } peers { permanent_uuid: "5805dfc51ef14c8ba35dceab65b9aa4c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40239 } }
I20260808 15:57:01.692291 28116 raft_consensus.cc:348] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10bbb740e1a147d5bb3566d0a05eaf8f" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42449 } } peers { permanent_uuid: "db17366ca1824be483d75ae442f7cdfe" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36905 } } peers { permanent_uuid: "5805dfc51ef14c8ba35dceab65b9aa4c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40239 } }
I20260808 15:57:01.692523 28116 raft_consensus.cc:374] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:01.692586 28116 raft_consensus.cc:729] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db17366ca1824be483d75ae442f7cdfe, State: Initialized, Role: FOLLOWER
I20260808 15:57:01.692796 28117 ts_tablet_manager.cc:1428] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c: Time spent starting tablet: real 0.006s user 0.000s sys 0.007s
I20260808 15:57:01.692981 28116 consensus_queue.cc:260] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10bbb740e1a147d5bb3566d0a05eaf8f" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42449 } } peers { permanent_uuid: "db17366ca1824be483d75ae442f7cdfe" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36905 } } peers { permanent_uuid: "5805dfc51ef14c8ba35dceab65b9aa4c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40239 } }
I20260808 15:57:01.693198 27647 heartbeater.cc:503] Master 127.19.93.62:32897 was elected leader, sending a full tablet report...
I20260808 15:57:01.693605 27868 heartbeater.cc:503] Master 127.19.93.62:32897 was elected leader, sending a full tablet report...
I20260808 15:57:01.693862 28116 ts_tablet_manager.cc:1428] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260808 15:57:01.723526 27870 tablet.cc:2369] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:57:01.732174 28129 raft_consensus.cc:482] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:57:01.732322 28129 raft_consensus.cc:504] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10bbb740e1a147d5bb3566d0a05eaf8f" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42449 } } peers { permanent_uuid: "db17366ca1824be483d75ae442f7cdfe" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36905 } } peers { permanent_uuid: "5805dfc51ef14c8ba35dceab65b9aa4c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40239 } }
I20260808 15:57:01.733320 28129 leader_election.cc:288] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10bbb740e1a147d5bb3566d0a05eaf8f (127.19.93.3:42449), 5805dfc51ef14c8ba35dceab65b9aa4c (127.19.93.1:40239)
I20260808 15:57:01.735206 28108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.733708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:46391 (local address 127.19.93.1:40239)
0808 15:57:01.733857 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:01.733862 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:01.733995 (+ 133us) server_negotiation.cc:407] Connection header received
0808 15:57:01.734107 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:01.734110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:01.734147 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:01.734217 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:01.734823 (+ 606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:01.734826 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:01.734829 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:01.734840 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:01.734857 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:01.734865 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:01.734940 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:01.735032 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 15:57:01.735092 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 15:57:01.735227 28134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.733548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:40239 (local address 127.19.93.2:46391)
0808 15:57:01.733914 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:01.733927 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:01.734016 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:01.734254 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:01.734258 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:01.734272 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:01.734677 (+ 405us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:57:01.734680 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:01.734690 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:57:01.734717 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:01.734934 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:01.734936 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:01.734938 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 15:57:01.735003 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 15:57:01.735041 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":120,"threads_started":1}
I20260808 15:57:01.735235 28114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.733616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:44689 (local address 127.19.93.3:42449)
0808 15:57:01.733735 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:01.733739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:01.733753 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:57:01.733903 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:01.733907 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:01.733950 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:01.734021 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:01.734682 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:01.734685 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:01.734688 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:01.734699 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:01.734721 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:01.734728 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:01.734806 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:01.735081 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 15:57:01.735120 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:57:01.735236 27871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.733515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:42449 (local address 127.19.93.2:44689)
0808 15:57:01.733701 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:01.733716 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:01.733790 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:01.734058 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:01.734060 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:01.734077 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:01.734543 (+ 466us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:57:01.734545 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:01.734554 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:57:01.734578 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:01.734977 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:01.734979 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:01.734982 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 15:57:01.735046 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 15:57:01.735097 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111}
I20260808 15:57:01.735809 27576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ed90754bfe341de9564e68d180b7012" candidate_uuid: "db17366ca1824be483d75ae442f7cdfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5805dfc51ef14c8ba35dceab65b9aa4c" is_pre_election: true
I20260808 15:57:01.735810 28010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ed90754bfe341de9564e68d180b7012" candidate_uuid: "db17366ca1824be483d75ae442f7cdfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10bbb740e1a147d5bb3566d0a05eaf8f" is_pre_election: true
I20260808 15:57:01.736053 28010 raft_consensus.cc:2454] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db17366ca1824be483d75ae442f7cdfe in term 0.
I20260808 15:57:01.736065 27576 raft_consensus.cc:2454] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db17366ca1824be483d75ae442f7cdfe in term 0.
I20260808 15:57:01.736490 27683 leader_election.cc:302] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10bbb740e1a147d5bb3566d0a05eaf8f, db17366ca1824be483d75ae442f7cdfe; no voters:
I20260808 15:57:01.736716 28129 raft_consensus.cc:2781] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:57:01.736788 28129 raft_consensus.cc:482] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:57:01.736817 28129 raft_consensus.cc:3037] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:01.737787 28129 raft_consensus.cc:504] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10bbb740e1a147d5bb3566d0a05eaf8f" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42449 } } peers { permanent_uuid: "db17366ca1824be483d75ae442f7cdfe" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36905 } } peers { permanent_uuid: "5805dfc51ef14c8ba35dceab65b9aa4c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40239 } }
I20260808 15:57:01.738094 28129 leader_election.cc:288] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [CANDIDATE]: Term 1 election: Requested vote from peers 10bbb740e1a147d5bb3566d0a05eaf8f (127.19.93.3:42449), 5805dfc51ef14c8ba35dceab65b9aa4c (127.19.93.1:40239)
I20260808 15:57:01.738365 28010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ed90754bfe341de9564e68d180b7012" candidate_uuid: "db17366ca1824be483d75ae442f7cdfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10bbb740e1a147d5bb3566d0a05eaf8f"
I20260808 15:57:01.738404 27576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ed90754bfe341de9564e68d180b7012" candidate_uuid: "db17366ca1824be483d75ae442f7cdfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5805dfc51ef14c8ba35dceab65b9aa4c"
I20260808 15:57:01.738507 27576 raft_consensus.cc:3037] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:01.738500 28010 raft_consensus.cc:3037] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:01.739414 27576 raft_consensus.cc:2454] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db17366ca1824be483d75ae442f7cdfe in term 1.
I20260808 15:57:01.739575 28010 raft_consensus.cc:2454] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db17366ca1824be483d75ae442f7cdfe in term 1.
I20260808 15:57:01.739682 27680 leader_election.cc:302] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5805dfc51ef14c8ba35dceab65b9aa4c, db17366ca1824be483d75ae442f7cdfe; no voters:
I20260808 15:57:01.739847 28129 raft_consensus.cc:2781] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:01.740046 28129 raft_consensus.cc:686] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [term 1 LEADER]: Becoming Leader. State: Replica: db17366ca1824be483d75ae442f7cdfe, State: Running, Role: LEADER
I20260808 15:57:01.740346 28129 consensus_queue.cc:237] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10bbb740e1a147d5bb3566d0a05eaf8f" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42449 } } peers { permanent_uuid: "db17366ca1824be483d75ae442f7cdfe" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36905 } } peers { permanent_uuid: "5805dfc51ef14c8ba35dceab65b9aa4c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40239 } }
I20260808 15:57:01.743187 27337 catalog_manager.cc:5495] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe reported cstate change: term changed from 0 to 1, leader changed from <none> to db17366ca1824be483d75ae442f7cdfe (127.19.93.2). New cstate: current_term: 1 leader_uuid: "db17366ca1824be483d75ae442f7cdfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10bbb740e1a147d5bb3566d0a05eaf8f" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db17366ca1824be483d75ae442f7cdfe" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5805dfc51ef14c8ba35dceab65b9aa4c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20260808 15:57:01.766275 28113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.765067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41826 (local address 127.19.93.2:36905)
0808 15:57:01.765194 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:01.765197 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:01.765209 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:57:01.765329 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:01.765331 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:01.765381 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:01.765443 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:01.765972 (+ 529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:01.765975 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:01.765976 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:01.765987 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:01.766004 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:01.766012 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:01.766085 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:01.766128 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 15:57:01.766158 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 15:57:01.771315 28010 raft_consensus.cc:1261] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f [term 1 FOLLOWER]: Refusing update from remote peer db17366ca1824be483d75ae442f7cdfe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:01.771324 27576 raft_consensus.cc:1261] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c [term 1 FOLLOWER]: Refusing update from remote peer db17366ca1824be483d75ae442f7cdfe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:01.771988 28135 consensus_queue.cc:1035] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "5805dfc51ef14c8ba35dceab65b9aa4c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:01.772162 28129 consensus_queue.cc:1035] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "10bbb740e1a147d5bb3566d0a05eaf8f" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:01.780233 28142 mvcc.cc:205] Tried to move back new op lower bound from 7316294130769391616 to 7316294130650546176. Current Snapshot: MvccSnapshot[applied={T|T < 7316294130769391616 or (T in {7316294130769391616})}]
I20260808 15:57:01.785974 27341 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42864:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:01.786095 27341 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42864:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:01.788254 27341 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 766aac881b284ff8810a06977f065319: Sending DeleteTablet for 3 replicas of tablet 6ed90754bfe341de9564e68d180b7012
I20260808 15:57:01.788933 27750 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ed90754bfe341de9564e68d180b7012 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:01 UTC) from {username='slave'} at 127.0.0.1:41810
I20260808 15:57:01.788990 27542 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ed90754bfe341de9564e68d180b7012 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:01 UTC) from {username='slave'} at 127.0.0.1:44294
I20260808 15:57:01.789347 28158 tablet_replica.cc:330] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c: stopping tablet replica
I20260808 15:57:01.789388 27972 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ed90754bfe341de9564e68d180b7012 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:01 UTC) from {username='slave'} at 127.0.0.1:49048
I20260808 15:57:01.789606 28158 raft_consensus.cc:2229] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:01.789811 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 27433
I20260808 15:57:01.789861 28158 raft_consensus.cc:2258] T 6ed90754bfe341de9564e68d180b7012 P 5805dfc51ef14c8ba35dceab65b9aa4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:01.790325 28159 tablet_replica.cc:330] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe: stopping tablet replica
I20260808 15:57:01.790079 28160 tablet_replica.cc:330] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f: stopping tablet replica
I20260808 15:57:01.790719 28160 raft_consensus.cc:2229] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:01.791015 28159 raft_consensus.cc:2229] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:57:01.791371 28159 raft_consensus.cc:2258] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:01.791680 28160 raft_consensus.cc:2258] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:01.796751 28159 ts_tablet_manager.cc:1905] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:01.796751 28160 ts_tablet_manager.cc:1905] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:01.799374 28159 ts_tablet_manager.cc:1918] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:01.799377 28160 ts_tablet_manager.cc:1918] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:01.799464 28160 log.cc:1196] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/6ed90754bfe341de9564e68d180b7012
I20260808 15:57:01.799575 28159 log.cc:1196] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/6ed90754bfe341de9564e68d180b7012
I20260808 15:57:01.799764 28160 ts_tablet_manager.cc:1939] T 6ed90754bfe341de9564e68d180b7012 P 10bbb740e1a147d5bb3566d0a05eaf8f: Deleting consensus metadata
I20260808 15:57:01.799993 28159 ts_tablet_manager.cc:1939] T 6ed90754bfe341de9564e68d180b7012 P db17366ca1824be483d75ae442f7cdfe: Deleting consensus metadata
I20260808 15:57:01.800974 27319 catalog_manager.cc:4841] TS 10bbb740e1a147d5bb3566d0a05eaf8f (127.19.93.3:42449): tablet 6ed90754bfe341de9564e68d180b7012 (table test-table [id=129759cf4bbd432badebf92a3c14263a]) successfully deleted
I20260808 15:57:01.801043 27314 catalog_manager.cc:4841] TS db17366ca1824be483d75ae442f7cdfe (127.19.93.2:36905): tablet 6ed90754bfe341de9564e68d180b7012 (table test-table [id=129759cf4bbd432badebf92a3c14263a]) successfully deleted
W20260808 15:57:01.802500 27317 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:40239 (error 108)
I20260808 15:57:01.802676 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 27653
I20260808 15:57:01.806964 28106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:01.805392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:40239 (local address 127.0.0.1:44310)
0808 15:57:01.806800 (+ 1408us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:01.806878 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:40239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1315}
W20260808 15:57:01.807113 27317 catalog_manager.cc:4584] TS 5805dfc51ef14c8ba35dceab65b9aa4c (127.19.93.1:40239): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6ed90754bfe341de9564e68d180b7012: Network error: Client connection negotiation failed: client connection to 127.19.93.1:40239: connect: Connection refused (error 111)
I20260808 15:57:01.813701 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 27875
I20260808 15:57:01.825008 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 27289
2026-08-08T15:57:01Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (929 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 15:57:01.848754 19828 mini_oidc.cc:152] Starting JWKS server
I20260808 15:57:01.850493 19828 webserver.cc:460] Webserver started at https://127.0.0.1:33469/ using document root <none> and password file <none>
I20260808 15:57:01.850633 19828 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 15:57:01.850852 19828 webserver.cc:460] Webserver started at http://127.0.0.1:46791/ using document root <none> and password file <none>
2026-08-08T15:57:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:57:01Z Disabled control of system clock
I20260808 15:57:01.860330 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:42535
--webserver_interface=127.19.93.62
--webserver_port=0
--builtin_ntp_servers=127.19.93.20:42451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:42535
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33469/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/testchainca.cert with env {}
W20260808 15:57:01.967430 28174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:01.967660 28174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:01.967696 28174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:01.971626 28174 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:57:01.971685 28174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:01.971705 28174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:01.971725 28174 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:57:01.971763 28174 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 15:57:01.971786 28174 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 15:57:01.971802 28174 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33469/jwks.json
I20260808 15:57:01.977766 28174 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:42451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:42535
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:42535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33469/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:01.978736 28174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:01.979689 28174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:01.987721 28190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:01.987756 28194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:01.987751 28192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:01.987910 28174 server_base.cc:1034] running on GCE node
I20260808 15:57:01.988515 28174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:01.989539 28174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:01.990701 28174 hybrid_clock.cc:648] HybridClock initialized: now 1786204621990688 us; error 30 us; skew 500 ppm
I20260808 15:57:01.992441 28174 webserver.cc:460] Webserver started at http://127.19.93.62:40463/ using document root <none> and password file <none>
I20260808 15:57:01.992964 28174 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:01.993031 28174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:01.993229 28174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:01.995198 28174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "e67b4113faf445768b34dfd05a4524c3"
format_stamp: "Formatted at 2026-08-08 15:57:01 on dist-test-slave-lgr5"
server_key: "81b0082d5f21084943c91f22f6644bf6"
server_key_iv: "84986fd8471921738c05c4b4636c9c22"
server_key_version: "encryptionkey@0"
I20260808 15:57:01.995774 28174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "e67b4113faf445768b34dfd05a4524c3"
format_stamp: "Formatted at 2026-08-08 15:57:01 on dist-test-slave-lgr5"
server_key: "81b0082d5f21084943c91f22f6644bf6"
server_key_iv: "84986fd8471921738c05c4b4636c9c22"
server_key_version: "encryptionkey@0"
I20260808 15:57:01.999241 28174 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:57:02.001488 28206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:02.002609 28174 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:57:02.002719 28174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "e67b4113faf445768b34dfd05a4524c3"
format_stamp: "Formatted at 2026-08-08 15:57:01 on dist-test-slave-lgr5"
server_key: "81b0082d5f21084943c91f22f6644bf6"
server_key_iv: "84986fd8471921738c05c4b4636c9c22"
server_key_version: "encryptionkey@0"
I20260808 15:57:02.002810 28174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:02.022804 28174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:02.023391 28174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:02.023545 28174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:02.030066 28174 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:42535
I20260808 15:57:02.030083 28288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:42535 every 8 connection(s)
I20260808 15:57:02.030901 28174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:57:02.033885 28289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:02.035560 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 28174
I20260808 15:57:02.035669 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:57:02.035923 19828 external_mini_cluster.cc:1428] Setting key ab9a2207750b226369e33508dc4e61dc
I20260808 15:57:02.039970 28289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3: Bootstrap starting.
I20260808 15:57:02.042145 28289 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:02.042922 28289 log.cc:824] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:02.044477 28295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:02.037206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37524 (local address 127.19.93.62:42535)
0808 15:57:02.037831 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:02.037854 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:02.037891 (+ 37us) server_negotiation.cc:407] Connection header received
0808 15:57:02.038525 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:02.038541 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:02.038908 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:02.039196 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:02.039590 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.040562 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.041401 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.041840 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.041992 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:02.042795 (+ 803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:02.042799 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:02.042810 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:02.043254 (+ 444us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:02.043308 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:02.043329 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:02.043422 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:02.043555 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 15:57:02.043782 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":118,"threads_started":1}
I20260808 15:57:02.044788 28289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3: No bootstrap required, opened a new log
I20260808 15:57:02.047091 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:57:02.048743 28289 raft_consensus.cc:348] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e67b4113faf445768b34dfd05a4524c3" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42535 } }
I20260808 15:57:02.048969 28289 raft_consensus.cc:374] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:02.049023 28289 raft_consensus.cc:729] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e67b4113faf445768b34dfd05a4524c3, State: Initialized, Role: FOLLOWER
I20260808 15:57:02.049404 28289 consensus_queue.cc:260] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e67b4113faf445768b34dfd05a4524c3" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42535 } }
I20260808 15:57:02.049525 28289 raft_consensus.cc:388] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:57:02.049590 28289 raft_consensus.cc:482] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:57:02.049683 28289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:02.050443 28289 raft_consensus.cc:504] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e67b4113faf445768b34dfd05a4524c3" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42535 } }
I20260808 15:57:02.050768 28289 leader_election.cc:302] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e67b4113faf445768b34dfd05a4524c3; no voters:
I20260808 15:57:02.051074 28289 leader_election.cc:288] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:57:02.051182 28298 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:02.051394 28298 raft_consensus.cc:686] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [term 1 LEADER]: Becoming Leader. State: Replica: e67b4113faf445768b34dfd05a4524c3, State: Running, Role: LEADER
I20260808 15:57:02.051663 28298 consensus_queue.cc:237] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e67b4113faf445768b34dfd05a4524c3" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42535 } }
I20260808 15:57:02.052251 28289 sys_catalog.cc:564] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:57:02.053164 28302 sys_catalog.cc:455] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e67b4113faf445768b34dfd05a4524c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e67b4113faf445768b34dfd05a4524c3" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42535 } } }
I20260808 15:57:02.053164 28305 sys_catalog.cc:455] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e67b4113faf445768b34dfd05a4524c3. Latest consensus state: current_term: 1 leader_uuid: "e67b4113faf445768b34dfd05a4524c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e67b4113faf445768b34dfd05a4524c3" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42535 } } }
I20260808 15:57:02.053308 28305 sys_catalog.cc:458] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:02.053308 28302 sys_catalog.cc:458] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:02.053700 28316 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:57:02.056320 28316 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:57:02.061745 28316 catalog_manager.cc:1347] Generated new cluster ID: 2e038d7acca14bb687b8ba9f9a6b926e
I20260808 15:57:02.061793 28316 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:57:02.068622 28316 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:57:02.069664 28316 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:57:02.081816 28316 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e67b4113faf445768b34dfd05a4524c3: Generated new TSK 0
I20260808 15:57:02.082495 28316 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 15:57:02.118341 28341 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 15:57:02.118486 28341 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 15:57:02.118901 28295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:02.094713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37538 (local address 127.19.93.62:42535)
0808 15:57:02.094836 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:02.094841 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:02.095042 (+ 201us) server_negotiation.cc:407] Connection header received
0808 15:57:02.095261 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:02.095263 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:02.095306 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:02.095389 (+ 83us) server_negotiation.cc:226] Negotiated authn=JWT
0808 15:57:02.095618 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.096182 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.097386 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.097594 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.097659 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:02.097976 (+ 317us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 15:57:02.118508 (+ 20532us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33469/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 15:57:02.118778 (+ 270us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37538: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33469/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 15:57:02.118973 28295 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37538: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33469/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 15:57:02.120431 28340 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:02.094634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42535 (local address 127.0.0.1:37538)
0808 15:57:02.094964 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:02.094979 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:02.095124 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:02.095409 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:02.095412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:02.095421 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0808 15:57:02.095529 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:02.095536 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.096282 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.096286 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:02.097280 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:02.097290 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.097683 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.097687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:02.097775 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:02.097825 (+ 50us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 15:57:02.118751 (+ 20926us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33469/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 15:57:02.118969 (+ 218us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.93.62:42535: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33469/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":94,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.19.93.62:42535: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33469/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 15:57:02.121117 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 28174
2026-08-08T15:57:02Z chronyd exiting
I20260808 15:57:02.162789 19828 test_util.cc:175] -----------------------------------------------
I20260808 15:57:02.162882 19828 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786204595622323-19828-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (315 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 15:57:02.164073 19828 mini_oidc.cc:152] Starting JWKS server
I20260808 15:57:02.164924 19828 webserver.cc:460] Webserver started at https://127.0.0.1:45789/ using document root <none> and password file <none>
I20260808 15:57:02.165016 19828 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 15:57:02.165274 19828 webserver.cc:460] Webserver started at http://127.0.0.1:34725/ using document root <none> and password file <none>
2026-08-08T15:57:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:57:02Z Disabled control of system clock
I20260808 15:57:02.174577 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:34945
--webserver_interface=127.19.93.62
--webserver_port=0
--builtin_ntp_servers=127.19.93.20:36949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:34945
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45789/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/testchainca.cert with env {}
W20260808 15:57:02.280954 28352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:02.281180 28352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:02.281215 28352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:02.285063 28352 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:57:02.285113 28352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:02.285127 28352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:02.285141 28352 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:57:02.285154 28352 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 15:57:02.285168 28352 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 15:57:02.285179 28352 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45789/jwks.json
I20260808 15:57:02.290266 28352 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:34945
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:34945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45789/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28352
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:02.291134 28352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:02.292037 28352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:02.299892 28361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:02.300005 28352 server_base.cc:1034] running on GCE node
W20260808 15:57:02.299929 28366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:02.299914 28363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:02.300678 28352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:02.301645 28352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:02.302800 28352 hybrid_clock.cc:648] HybridClock initialized: now 1786204622302784 us; error 30 us; skew 500 ppm
I20260808 15:57:02.304562 28352 webserver.cc:460] Webserver started at http://127.19.93.62:46193/ using document root <none> and password file <none>
I20260808 15:57:02.305094 28352 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:02.305157 28352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:02.305334 28352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:02.307222 28352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "a0b95725eb75476a9a86292315be0a2d"
format_stamp: "Formatted at 2026-08-08 15:57:02 on dist-test-slave-lgr5"
server_key: "cbed50184a46c4184b773bc836b4984f"
server_key_iv: "e97794a0bdb56156fa7531300eeee28e"
server_key_version: "encryptionkey@0"
I20260808 15:57:02.307876 28352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "a0b95725eb75476a9a86292315be0a2d"
format_stamp: "Formatted at 2026-08-08 15:57:02 on dist-test-slave-lgr5"
server_key: "cbed50184a46c4184b773bc836b4984f"
server_key_iv: "e97794a0bdb56156fa7531300eeee28e"
server_key_version: "encryptionkey@0"
I20260808 15:57:02.311353 28352 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:57:02.313625 28379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:02.314708 28352 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:57:02.314817 28352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "a0b95725eb75476a9a86292315be0a2d"
format_stamp: "Formatted at 2026-08-08 15:57:02 on dist-test-slave-lgr5"
server_key: "cbed50184a46c4184b773bc836b4984f"
server_key_iv: "e97794a0bdb56156fa7531300eeee28e"
server_key_version: "encryptionkey@0"
I20260808 15:57:02.314906 28352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:02.331493 28352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:02.332074 28352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:02.332266 28352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:02.338829 28352 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:34945
I20260808 15:57:02.338835 28471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:34945 every 8 connection(s)
I20260808 15:57:02.339696 28352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:57:02.342691 28472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:02.348308 28472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d: Bootstrap starting.
I20260808 15:57:02.349691 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 28352
I20260808 15:57:02.349817 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:57:02.350138 19828 external_mini_cluster.cc:1428] Setting key e1c77a32606cee32615d11e21c9eb265
I20260808 15:57:02.351174 28472 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:02.352010 28472 log.cc:824] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:02.353947 28472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d: No bootstrap required, opened a new log
I20260808 15:57:02.357452 28472 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0b95725eb75476a9a86292315be0a2d" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34945 } }
I20260808 15:57:02.357687 28472 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:02.357748 28472 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0b95725eb75476a9a86292315be0a2d, State: Initialized, Role: FOLLOWER
I20260808 15:57:02.358172 28472 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0b95725eb75476a9a86292315be0a2d" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34945 } }
I20260808 15:57:02.358294 28472 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:57:02.358351 28472 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:57:02.358441 28472 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:02.358884 28478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:02.351197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57066 (local address 127.19.93.62:34945)
0808 15:57:02.351836 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:02.351850 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:02.351882 (+ 32us) server_negotiation.cc:407] Connection header received
0808 15:57:02.352601 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:02.352625 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:02.352991 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:02.353289 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:02.353694 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.354655 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.355557 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.356020 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.356184 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:02.357060 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:02.357065 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:02.357077 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:02.357426 (+ 349us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:02.357480 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:02.357499 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:02.357573 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:02.357766 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 15:57:02.358135 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":144,"threads_started":1}
I20260808 15:57:02.359256 28472 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0b95725eb75476a9a86292315be0a2d" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34945 } }
I20260808 15:57:02.359557 28472 leader_election.cc:302] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0b95725eb75476a9a86292315be0a2d; no voters:
I20260808 15:57:02.359813 28472 leader_election.cc:288] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:57:02.359899 28481 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:02.360131 28481 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [term 1 LEADER]: Becoming Leader. State: Replica: a0b95725eb75476a9a86292315be0a2d, State: Running, Role: LEADER
I20260808 15:57:02.360419 28481 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0b95725eb75476a9a86292315be0a2d" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34945 } }
I20260808 15:57:02.361054 28472 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:57:02.361533 28481 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0b95725eb75476a9a86292315be0a2d. Latest consensus state: current_term: 1 leader_uuid: "a0b95725eb75476a9a86292315be0a2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0b95725eb75476a9a86292315be0a2d" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34945 } } }
I20260808 15:57:02.361656 28481 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:02.361905 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:57:02.361986 28484 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0b95725eb75476a9a86292315be0a2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0b95725eb75476a9a86292315be0a2d" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34945 } } }
I20260808 15:57:02.362100 28484 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d [sys.catalog]: This master's current role is: LEADER
W20260808 15:57:02.365712 28504 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:57:02.365777 28504 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:57:02.365829 28490 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:57:02.366461 28490 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:57:02.371187 28490 catalog_manager.cc:1347] Generated new cluster ID: 3bdd3710f53d4d96850df89d7b7c5a80
I20260808 15:57:02.371248 28490 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:57:02.378378 28490 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:57:02.379182 28490 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:57:02.388716 28490 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0b95725eb75476a9a86292315be0a2d: Generated new TSK 0
I20260808 15:57:02.389278 28490 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 15:57:02.410809 28522 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 15:57:02.410871 28522 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 15:57:02.411506 28478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:02.396333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57068 (local address 127.19.93.62:34945)
0808 15:57:02.396444 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:02.396449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:02.396578 (+ 129us) server_negotiation.cc:407] Connection header received
0808 15:57:02.396710 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:02.396713 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:02.396765 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:02.396870 (+ 105us) server_negotiation.cc:226] Negotiated authn=JWT
0808 15:57:02.397056 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.397854 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.398661 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.399012 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.399105 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:02.399357 (+ 252us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 15:57:02.411151 (+ 11794us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45789/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 15:57:02.411381 (+ 230us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57068: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45789/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 15:57:02.411569 28478 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57068: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45789/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 15:57:02.411639 28521 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:02.396240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34945 (local address 127.0.0.1:57068)
0808 15:57:02.396505 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:02.396516 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:02.396608 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:02.396862 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:02.396864 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:02.396870 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0808 15:57:02.396973 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:02.396978 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.397949 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.397952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:02.398563 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:02.398570 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.399117 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.399120 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:02.399193 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:02.399216 (+ 23us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 15:57:02.411345 (+ 12129us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45789/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 15:57:02.411488 (+ 143us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.93.62:34945: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45789/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":105,"threads_started":1}
I20260808 15:57:02.412227 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 28352
2026-08-08T15:57:02Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (293 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 15:57:02.457301 19828 mini_oidc.cc:152] Starting JWKS server
I20260808 15:57:02.458148 19828 webserver.cc:460] Webserver started at https://127.0.0.1:38677/ using document root <none> and password file <none>
I20260808 15:57:02.458252 19828 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 15:57:02.458503 19828 webserver.cc:460] Webserver started at http://127.0.0.1:35317/ using document root <none> and password file <none>
2026-08-08T15:57:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:57:02Z Disabled control of system clock
I20260808 15:57:02.468039 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:42209
--webserver_interface=127.19.93.62
--webserver_port=0
--builtin_ntp_servers=127.19.93.20:42065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:42209
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38677/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 15:57:02.573793 28530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:02.574010 28530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:02.574049 28530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:02.577911 28530 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:57:02.577958 28530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:02.577972 28530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:02.577988 28530 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:57:02.578016 28530 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 15:57:02.578043 28530 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 15:57:02.578068 28530 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38677/jwks.json
I20260808 15:57:02.582556 28530 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:42065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:42209
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:42209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38677/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:02.583441 28530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:02.584743 28530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:02.592341 28538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:02.592381 28537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:02.592424 28530 server_base.cc:1034] running on GCE node
W20260808 15:57:02.592408 28541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:02.593106 28530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:02.594126 28530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:02.595321 28530 hybrid_clock.cc:648] HybridClock initialized: now 1786204622595308 us; error 33 us; skew 500 ppm
I20260808 15:57:02.597039 28530 webserver.cc:460] Webserver started at http://127.19.93.62:36609/ using document root <none> and password file <none>
I20260808 15:57:02.597550 28530 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:02.597615 28530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:02.597787 28530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:02.599709 28530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "082da52f635746e5a1b347b9f2ba3ef4"
format_stamp: "Formatted at 2026-08-08 15:57:02 on dist-test-slave-lgr5"
server_key: "6f719bd0db39c5346d5b8e3271551b0e"
server_key_iv: "2be0de9e42fb269b6953cb60094c32bd"
server_key_version: "encryptionkey@0"
I20260808 15:57:02.600301 28530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "082da52f635746e5a1b347b9f2ba3ef4"
format_stamp: "Formatted at 2026-08-08 15:57:02 on dist-test-slave-lgr5"
server_key: "6f719bd0db39c5346d5b8e3271551b0e"
server_key_iv: "2be0de9e42fb269b6953cb60094c32bd"
server_key_version: "encryptionkey@0"
I20260808 15:57:02.603757 28530 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:57:02.605979 28553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:02.607044 28530 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:02.607151 28530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "082da52f635746e5a1b347b9f2ba3ef4"
format_stamp: "Formatted at 2026-08-08 15:57:02 on dist-test-slave-lgr5"
server_key: "6f719bd0db39c5346d5b8e3271551b0e"
server_key_iv: "2be0de9e42fb269b6953cb60094c32bd"
server_key_version: "encryptionkey@0"
I20260808 15:57:02.607235 28530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:02.623858 28530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:02.624491 28530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:02.624644 28530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:02.630790 28530 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:42209
I20260808 15:57:02.630811 28638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:42209 every 8 connection(s)
I20260808 15:57:02.631685 28530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:57:02.632738 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 28530
I20260808 15:57:02.632844 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:57:02.633103 19828 external_mini_cluster.cc:1428] Setting key 455bb1faf113ef1e4771a4185b7f3124
I20260808 15:57:02.634471 28639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:02.640821 28639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4: Bootstrap starting.
I20260808 15:57:02.642867 28642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:02.634346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60122 (local address 127.19.93.62:42209)
0808 15:57:02.634972 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:02.634992 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:02.635033 (+ 41us) server_negotiation.cc:407] Connection header received
0808 15:57:02.635858 (+ 825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:02.635881 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:02.636352 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:02.636705 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:02.637110 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.638535 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.639347 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.640035 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.640233 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:02.640967 (+ 734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:02.640974 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:02.640987 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:02.641443 (+ 456us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:02.641510 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:02.641536 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:02.641627 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:02.641745 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 15:57:02.642007 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":119,"threads_started":1}
I20260808 15:57:02.643388 28639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:02.644158 28639 log.cc:824] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:02.645604 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:57:02.646076 28639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4: No bootstrap required, opened a new log
I20260808 15:57:02.649545 28639 raft_consensus.cc:348] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "082da52f635746e5a1b347b9f2ba3ef4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42209 } }
I20260808 15:57:02.649748 28639 raft_consensus.cc:374] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:02.649806 28639 raft_consensus.cc:729] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 082da52f635746e5a1b347b9f2ba3ef4, State: Initialized, Role: FOLLOWER
I20260808 15:57:02.650183 28639 consensus_queue.cc:260] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "082da52f635746e5a1b347b9f2ba3ef4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42209 } }
I20260808 15:57:02.650305 28639 raft_consensus.cc:388] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:57:02.650367 28639 raft_consensus.cc:482] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:57:02.650462 28639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:02.651273 28639 raft_consensus.cc:504] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "082da52f635746e5a1b347b9f2ba3ef4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42209 } }
I20260808 15:57:02.651580 28639 leader_election.cc:302] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 082da52f635746e5a1b347b9f2ba3ef4; no voters:
I20260808 15:57:02.651855 28639 leader_election.cc:288] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:57:02.651999 28644 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:02.652251 28644 raft_consensus.cc:686] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [term 1 LEADER]: Becoming Leader. State: Replica: 082da52f635746e5a1b347b9f2ba3ef4, State: Running, Role: LEADER
I20260808 15:57:02.652575 28644 consensus_queue.cc:237] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "082da52f635746e5a1b347b9f2ba3ef4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42209 } }
I20260808 15:57:02.653003 28639 sys_catalog.cc:564] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:57:02.654165 28647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 082da52f635746e5a1b347b9f2ba3ef4. Latest consensus state: current_term: 1 leader_uuid: "082da52f635746e5a1b347b9f2ba3ef4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "082da52f635746e5a1b347b9f2ba3ef4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42209 } } }
I20260808 15:57:02.654282 28647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:02.654587 28646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "082da52f635746e5a1b347b9f2ba3ef4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "082da52f635746e5a1b347b9f2ba3ef4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42209 } } }
I20260808 15:57:02.654703 28646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:02.654776 28668 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:57:02.657454 28668 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:57:02.663023 28668 catalog_manager.cc:1347] Generated new cluster ID: 7821f803a4ea472d88a8a6b75dd04564
I20260808 15:57:02.663080 28668 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:57:02.675151 28668 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:57:02.675925 28668 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:57:02.684279 28668 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 082da52f635746e5a1b347b9f2ba3ef4: Generated new TSK 0
I20260808 15:57:02.684850 28668 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:57:02.701741 28642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:02.697293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60128 (local address 127.19.93.62:42209)
0808 15:57:02.697445 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:02.697450 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:02.697619 (+ 169us) server_negotiation.cc:407] Connection header received
0808 15:57:02.697772 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:02.697774 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:02.697818 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:02.697905 (+ 87us) server_negotiation.cc:226] Negotiated authn=JWT
0808 15:57:02.698151 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.698666 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.699532 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.699739 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.699826 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:02.700158 (+ 332us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 15:57:02.701402 (+ 1244us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38677/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 15:57:02.701621 (+ 219us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60128: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38677/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 15:57:02.701798 28642 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60128: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38677/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 15:57:02.703588 28687 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:02.697203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42209 (local address 127.0.0.1:60128)
0808 15:57:02.697542 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:02.697552 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:02.697653 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:02.697933 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:02.697936 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:02.697945 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0808 15:57:02.698052 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:02.698057 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.698779 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.698783 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:02.699421 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:02.699429 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.699856 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.699861 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:02.699952 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:02.699974 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 15:57:02.701563 (+ 1589us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38677/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 15:57:02.703415 (+ 1852us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.93.62:42209: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38677/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":271,"mutex_wait_us":1654,"thread_start_us":92,"threads_started":1}
I20260808 15:57:02.704306 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 28530
E20260808 15:57:02.724360 28688 webserver.cc:533] Webserver: sslize failed:
E20260808 15:57:02.724426 28688 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T15:57:02Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (297 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T15:57:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:57:02Z Disabled control of system clock
I20260808 15:57:02.763693 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:38329
--webserver_interface=127.19.93.62
--webserver_port=0
--builtin_ntp_servers=127.19.93.20:44775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:38329
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/testchainca.cert with env {}
W20260808 15:57:02.873925 28699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:02.874168 28699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:02.874233 28699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:02.878244 28699 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:57:02.878311 28699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:02.878338 28699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:02.878372 28699 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:57:02.878407 28699 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 15:57:02.878434 28699 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 15:57:02.878465 28699 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 15:57:02.883620 28699 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:44775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:38329
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:38329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:02.884608 28699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:02.885589 28699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:02.893630 28710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:02.893718 28707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:02.893630 28708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:02.893896 28699 server_base.cc:1034] running on GCE node
I20260808 15:57:02.894454 28699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:02.895498 28699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:02.896665 28699 hybrid_clock.cc:648] HybridClock initialized: now 1786204622896643 us; error 35 us; skew 500 ppm
I20260808 15:57:02.898530 28699 webserver.cc:460] Webserver started at http://127.19.93.62:34647/ using document root <none> and password file <none>
I20260808 15:57:02.899058 28699 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:02.899132 28699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:02.899343 28699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:02.901332 28699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "679f7a69e9c44e0983d77c346b385909"
format_stamp: "Formatted at 2026-08-08 15:57:02 on dist-test-slave-lgr5"
server_key: "6929def2c12ebd367f5b308edd290a57"
server_key_iv: "0cf5dbd1a8f67f1901366053bd2aa50d"
server_key_version: "encryptionkey@0"
I20260808 15:57:02.901880 28699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "679f7a69e9c44e0983d77c346b385909"
format_stamp: "Formatted at 2026-08-08 15:57:02 on dist-test-slave-lgr5"
server_key: "6929def2c12ebd367f5b308edd290a57"
server_key_iv: "0cf5dbd1a8f67f1901366053bd2aa50d"
server_key_version: "encryptionkey@0"
I20260808 15:57:02.905403 28699 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:57:02.907687 28716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:02.908874 28699 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:02.908993 28699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "679f7a69e9c44e0983d77c346b385909"
format_stamp: "Formatted at 2026-08-08 15:57:02 on dist-test-slave-lgr5"
server_key: "6929def2c12ebd367f5b308edd290a57"
server_key_iv: "0cf5dbd1a8f67f1901366053bd2aa50d"
server_key_version: "encryptionkey@0"
I20260808 15:57:02.909090 28699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:02.924302 28699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:02.924901 28699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:02.925079 28699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:02.931890 28699 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:38329
I20260808 15:57:02.931901 28805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:38329 every 8 connection(s)
I20260808 15:57:02.932801 28699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:57:02.935514 28806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:02.938829 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 28699
I20260808 15:57:02.938959 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:57:02.939265 19828 external_mini_cluster.cc:1428] Setting key 4303f4d8eb04971c55711aa4f703207d
I20260808 15:57:02.941201 28806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909: Bootstrap starting.
I20260808 15:57:02.943235 28806 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:02.943910 28806 log.cc:824] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:02.945600 28806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909: No bootstrap required, opened a new log
I20260808 15:57:02.948061 28810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:02.940643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44930 (local address 127.19.93.62:38329)
0808 15:57:02.941238 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:02.941253 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:02.941296 (+ 43us) server_negotiation.cc:407] Connection header received
0808 15:57:02.941917 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:02.941933 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:02.942292 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:02.942589 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:02.943001 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.943990 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.944845 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:02.945303 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:02.945448 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:02.946267 (+ 819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:02.946272 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:02.946284 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:02.946635 (+ 351us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:02.946687 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:02.946707 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:02.946791 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:02.946927 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 15:57:02.947158 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":135,"threads_started":1}
I20260808 15:57:02.948668 28806 raft_consensus.cc:348] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "679f7a69e9c44e0983d77c346b385909" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38329 } }
I20260808 15:57:02.948917 28806 raft_consensus.cc:374] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:02.948982 28806 raft_consensus.cc:729] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 679f7a69e9c44e0983d77c346b385909, State: Initialized, Role: FOLLOWER
I20260808 15:57:02.949424 28806 consensus_queue.cc:260] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "679f7a69e9c44e0983d77c346b385909" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38329 } }
I20260808 15:57:02.949574 28806 raft_consensus.cc:388] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:57:02.949637 28806 raft_consensus.cc:482] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:57:02.949726 28806 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:02.950696 28806 raft_consensus.cc:504] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "679f7a69e9c44e0983d77c346b385909" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38329 } }
I20260808 15:57:02.950883 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:57:02.951030 28806 leader_election.cc:302] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 679f7a69e9c44e0983d77c346b385909; no voters:
I20260808 15:57:02.951311 28806 leader_election.cc:288] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:57:02.951387 28813 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:02.951602 28813 raft_consensus.cc:686] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [term 1 LEADER]: Becoming Leader. State: Replica: 679f7a69e9c44e0983d77c346b385909, State: Running, Role: LEADER
I20260808 15:57:02.951896 28813 consensus_queue.cc:237] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "679f7a69e9c44e0983d77c346b385909" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38329 } }
I20260808 15:57:02.952550 28806 sys_catalog.cc:564] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:57:02.953099 28813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 679f7a69e9c44e0983d77c346b385909. Latest consensus state: current_term: 1 leader_uuid: "679f7a69e9c44e0983d77c346b385909" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "679f7a69e9c44e0983d77c346b385909" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38329 } } }
I20260808 15:57:02.953217 28813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:02.953612 28814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "679f7a69e9c44e0983d77c346b385909" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "679f7a69e9c44e0983d77c346b385909" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38329 } } }
I20260808 15:57:02.953718 28814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:02.953980 28823 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:57:02.957510 28823 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:57:02.962950 28823 catalog_manager.cc:1347] Generated new cluster ID: 684279b722e644c5aacf8145a6d2a8e9
I20260808 15:57:02.963012 28823 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:57:02.979450 28823 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:57:02.980320 28823 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:57:02.984059 28823 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 679f7a69e9c44e0983d77c346b385909: Generated new TSK 0
I20260808 15:57:02.984755 28823 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:57:03.034016 28810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:03.001091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44932 (local address 127.19.93.62:38329)
0808 15:57:03.001207 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:03.001211 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:03.001372 (+ 161us) server_negotiation.cc:407] Connection header received
0808 15:57:03.001566 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:03.001568 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:03.001615 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:03.001705 (+ 90us) server_negotiation.cc:226] Negotiated authn=JWT
0808 15:57:03.001940 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:03.002466 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:03.003297 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:03.003516 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:03.003602 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:03.003912 (+ 310us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 15:57:03.033565 (+ 29653us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 15:57:03.033852 (+ 287us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44932: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":39}
W20260808 15:57:03.034106 28810 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44932: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 15:57:03.034152 28850 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:03.000981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:38329 (local address 127.0.0.1:44932)
0808 15:57:03.001293 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:03.001305 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:03.001444 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:03.001714 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:03.001717 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:03.001725 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0808 15:57:03.001837 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:03.001842 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:03.002568 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:03.002572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:03.003188 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:03.003195 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:03.003628 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:03.003632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:03.003724 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:03.003748 (+ 24us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 15:57:03.033796 (+ 30048us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 15:57:03.033985 (+ 189us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.93.62:38329: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":124,"threads_started":1}
I20260808 15:57:03.034574 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 28699
2026-08-08T15:57:03Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (307 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (121 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (120 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:57:03 dist-test-slave-lgr5 krb5kdc[28866](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:57:03 dist-test-slave-lgr5 krb5kdc[28866](info): set up 2 sockets
Aug 08 15:57:03 dist-test-slave-lgr5 krb5kdc[28866](info): commencing operation
krb5kdc: starting...
W20260808 15:57:04.434834 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:57:04 dist-test-slave-lgr5 krb5kdc[28866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204624, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:57:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:57:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:57:04.553074 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:43691
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:40249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:43691
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:04.660368 28891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:04.660604 28891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:04.660650 28891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:04.664464 28891 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:57:04.664505 28891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:04.664522 28891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:04.664536 28891 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:57:04.664556 28891 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:57:04.669586 28891 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:40249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:43691
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:43691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:04.670483 28891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:04.671382 28891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:04.679256 28900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:04.679239 28896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:04.679371 28891 server_base.cc:1034] running on GCE node
W20260808 15:57:04.679230 28898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:04.679961 28891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:04.681018 28891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:04.682191 28891 hybrid_clock.cc:648] HybridClock initialized: now 1786204624682167 us; error 33 us; skew 500 ppm
Aug 08 15:57:04 dist-test-slave-lgr5 krb5kdc[28866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204624, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:04.684742 28891 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:57:04.685590 28891 webserver.cc:460] Webserver started at http://127.19.93.62:42519/ using document root <none> and password file <none>
I20260808 15:57:04.686112 28891 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:04.686174 28891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:04.686442 28891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:04.688534 28891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "283e2e7261234112ae52cae7eed9dc68"
format_stamp: "Formatted at 2026-08-08 15:57:04 on dist-test-slave-lgr5"
server_key: "7fe3a127b4a81d9efb62a73d81807639"
server_key_iv: "843e72b32de9ec0a3a9325344b3796a1"
server_key_version: "encryptionkey@0"
I20260808 15:57:04.689079 28891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "283e2e7261234112ae52cae7eed9dc68"
format_stamp: "Formatted at 2026-08-08 15:57:04 on dist-test-slave-lgr5"
server_key: "7fe3a127b4a81d9efb62a73d81807639"
server_key_iv: "843e72b32de9ec0a3a9325344b3796a1"
server_key_version: "encryptionkey@0"
I20260808 15:57:04.692525 28891 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:57:04.694727 28912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:04.695845 28891 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:04.695950 28891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "283e2e7261234112ae52cae7eed9dc68"
format_stamp: "Formatted at 2026-08-08 15:57:04 on dist-test-slave-lgr5"
server_key: "7fe3a127b4a81d9efb62a73d81807639"
server_key_iv: "843e72b32de9ec0a3a9325344b3796a1"
server_key_version: "encryptionkey@0"
I20260808 15:57:04.696053 28891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:04.707501 28891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:04.710265 28891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:04.710435 28891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:04.716984 28891 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:43691
I20260808 15:57:04.716995 28999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:43691 every 8 connection(s)
I20260808 15:57:04.717854 28891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:57:04.718417 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 28891
I20260808 15:57:04.718531 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:57:04.718796 19828 external_mini_cluster.cc:1428] Setting key 55c98b0d9e8237b4d1488d17abaa5c13
I20260808 15:57:04.720842 29000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:04.727268 29000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68: Bootstrap starting.
Aug 08 15:57:04 dist-test-slave-lgr5 krb5kdc[28866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204624, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:57:04.729950 29000 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:04.730779 29000 log.cc:824] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:04.732920 29000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68: No bootstrap required, opened a new log
I20260808 15:57:04.733134 29005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:04.720146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35586 (local address 127.19.93.62:43691)
0808 15:57:04.720556 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:04.720576 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:04.720617 (+ 41us) server_negotiation.cc:407] Connection header received
0808 15:57:04.721417 (+ 800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:04.721439 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:04.721814 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:04.722147 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:04.722777 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:04.724273 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:04.725098 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:04.725765 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:04.725934 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:04.728432 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:04.728439 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:04.728454 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:04.728487 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:04.730299 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:04.730692 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:04.730698 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:04.730704 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:04.730840 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:04.731115 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:04.731118 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:04.731120 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:04.731529 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:04.731710 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:04.731949 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 15:57:04.732253 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":103,"threads_started":1}
I20260808 15:57:04.736567 29000 raft_consensus.cc:348] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283e2e7261234112ae52cae7eed9dc68" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 43691 } }
I20260808 15:57:04.736765 29000 raft_consensus.cc:374] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:04.736804 29000 raft_consensus.cc:729] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 283e2e7261234112ae52cae7eed9dc68, State: Initialized, Role: FOLLOWER
I20260808 15:57:04.737140 29000 consensus_queue.cc:260] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283e2e7261234112ae52cae7eed9dc68" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 43691 } }
I20260808 15:57:04.737246 29000 raft_consensus.cc:388] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:57:04.737289 29000 raft_consensus.cc:482] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:57:04.737355 29000 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:04.738090 29000 raft_consensus.cc:504] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283e2e7261234112ae52cae7eed9dc68" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 43691 } }
I20260808 15:57:04.738364 29000 leader_election.cc:302] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 283e2e7261234112ae52cae7eed9dc68; no voters:
I20260808 15:57:04.738601 29000 leader_election.cc:288] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:57:04.738698 29007 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:04.738894 29007 raft_consensus.cc:686] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [term 1 LEADER]: Becoming Leader. State: Replica: 283e2e7261234112ae52cae7eed9dc68, State: Running, Role: LEADER
I20260808 15:57:04.739226 29007 consensus_queue.cc:237] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283e2e7261234112ae52cae7eed9dc68" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 43691 } }
I20260808 15:57:04.739704 29000 sys_catalog.cc:564] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:57:04.740938 29008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "283e2e7261234112ae52cae7eed9dc68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283e2e7261234112ae52cae7eed9dc68" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 43691 } } }
I20260808 15:57:04.741075 29008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:04.740937 29009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 283e2e7261234112ae52cae7eed9dc68. Latest consensus state: current_term: 1 leader_uuid: "283e2e7261234112ae52cae7eed9dc68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283e2e7261234112ae52cae7eed9dc68" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 43691 } } }
I20260808 15:57:04.741340 29009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:04.741442 29025 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:57:04.744143 29025 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:57:04.748898 29025 catalog_manager.cc:1347] Generated new cluster ID: dc3ab340ea1f4ca7ae72f4df94a0a970
I20260808 15:57:04.748951 29025 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:57:04.772215 29025 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:57:04.773320 29025 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:57:04.777824 29025 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 283e2e7261234112ae52cae7eed9dc68: Generated new TSK 0
I20260808 15:57:04.778364 29025 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 15:57:04.810237 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:43691
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:40249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:04.917088 29039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:04.917325 29039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:04.917366 29039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:04.921268 29039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:04.921316 29039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:04.921372 29039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:57:04.926442 29039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:40249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:43691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:04.927369 29039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:04.928325 29039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:04.937322 29051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:04.937322 29054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:04.937354 29047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:04.937398 29039 server_base.cc:1034] running on GCE node
I20260808 15:57:04.937896 29039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:04.938493 29039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:04.939642 29039 hybrid_clock.cc:648] HybridClock initialized: now 1786204624939616 us; error 38 us; skew 500 ppm
Aug 08 15:57:04 dist-test-slave-lgr5 krb5kdc[28866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204624, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:04.942322 29039 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:57:04.943097 29039 webserver.cc:460] Webserver started at http://127.19.93.1:34691/ using document root <none> and password file <none>
I20260808 15:57:04.943593 29039 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:04.943657 29039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:04.943851 29039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:04.945796 29039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "157acc3eeb3847949e2791551a0f3aa2"
format_stamp: "Formatted at 2026-08-08 15:57:04 on dist-test-slave-lgr5"
server_key: "beb2a31c9e61f94945244e2d22bd59c5"
server_key_iv: "f74de53e74b657d8a49d8b7c164a1044"
server_key_version: "encryptionkey@0"
I20260808 15:57:04.946333 29039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "157acc3eeb3847949e2791551a0f3aa2"
format_stamp: "Formatted at 2026-08-08 15:57:04 on dist-test-slave-lgr5"
server_key: "beb2a31c9e61f94945244e2d22bd59c5"
server_key_iv: "f74de53e74b657d8a49d8b7c164a1044"
server_key_version: "encryptionkey@0"
I20260808 15:57:04.949748 29039 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:57:04.951942 29064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:04.953148 29039 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:04.953260 29039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "157acc3eeb3847949e2791551a0f3aa2"
format_stamp: "Formatted at 2026-08-08 15:57:04 on dist-test-slave-lgr5"
server_key: "beb2a31c9e61f94945244e2d22bd59c5"
server_key_iv: "f74de53e74b657d8a49d8b7c164a1044"
server_key_version: "encryptionkey@0"
I20260808 15:57:04.953372 29039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:04.963518 29039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:04.966475 29039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:04.966632 29039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:04.967201 29039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:04.967967 29039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:04.968021 29039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:04.968072 29039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:04.968124 29039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:04.976511 29039 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:34181
I20260808 15:57:04.976567 29286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:34181 every 8 connection(s)
I20260808 15:57:04.977360 29039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:57:04.985661 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 29039
I20260808 15:57:04.985777 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:57:04.986052 19828 external_mini_cluster.cc:1428] Setting key 94988936b44bd3636f0e6407089773ef
Aug 08 15:57:04 dist-test-slave-lgr5 krb5kdc[28866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204624, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:57:04.990607 29005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:04.979059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:40637 (local address 127.19.93.62:43691)
0808 15:57:04.979194 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:04.979198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:04.979996 (+ 798us) server_negotiation.cc:407] Connection header received
0808 15:57:04.981356 (+ 1360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:04.981360 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:04.981418 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:04.981493 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:04.982629 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:04.983170 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:04.984304 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:04.984549 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:04.984643 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:04.987145 (+ 2502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:04.987149 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:04.987151 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:04.987176 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:04.988695 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:04.989150 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:04.989153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:04.989155 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:04.989244 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:04.989565 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:04.989568 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:04.989571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:04.989749 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:04.989837 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:04.990315 (+ 478us) server_negotiation.cc:299] Negotiation successful
0808 15:57:04.990443 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:57:04.991508 29291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:04.979408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:43691 (local address 127.19.93.1:40637)
0808 15:57:04.979843 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:04.979885 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:04.981143 (+ 1258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:04.981667 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:04.981674 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:04.982001 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:04.982471 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:04.982484 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:04.983291 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:04.983294 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:04.984180 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:04.984190 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:04.984691 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:04.984695 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:04.984854 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:04.985411 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:04.985428 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:04.986959 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:04.988803 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:04.988808 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:04.988819 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:04.989060 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:04.989323 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:04.989325 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:04.989326 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:04.989474 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:04.989850 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:04.989857 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:04.990091 (+ 234us) client_negotiation.cc:769] Sending connection context
0808 15:57:04.990253 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 15:57:04.990573 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":115,"threads_started":1}
I20260808 15:57:04.992739 29287 heartbeater.cc:347] Connected to a master server at 127.19.93.62:43691
I20260808 15:57:04.992972 29287 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:04.993443 29287 heartbeater.cc:511] Master 127.19.93.62:43691 requested a full tablet report, sending...
I20260808 15:57:04.995051 28942 ts_manager.cc:194] Registered new tserver with Master: 157acc3eeb3847949e2791551a0f3aa2 (127.19.93.1:34181)
I20260808 15:57:04.996649 28942 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:40637
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 15:57:05.014664 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:43691
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:40249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:05.122490 29295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:05.122709 29295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:05.122750 29295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:05.126708 29295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:05.126761 29295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:05.126827 29295 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:57:05.131896 29295 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:40249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:43691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:05.132817 29295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:05.133828 29295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:05.144906 29310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:05.144935 29313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:05.144904 29309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:05.145387 29295 server_base.cc:1034] running on GCE node
I20260808 15:57:05.145812 29295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:05.146523 29295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:05.147706 29295 hybrid_clock.cc:648] HybridClock initialized: now 1786204625147676 us; error 41 us; skew 500 ppm
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[28866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204625, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:05.151163 29295 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:57:05.151947 29295 webserver.cc:460] Webserver started at http://127.19.93.2:45183/ using document root <none> and password file <none>
I20260808 15:57:05.152527 29295 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:05.152593 29295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:05.152779 29295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:05.154753 29295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "3ee2f2073d9747ffbb17d17e97b76d4a"
format_stamp: "Formatted at 2026-08-08 15:57:05 on dist-test-slave-lgr5"
server_key: "53bc25124ec1d4c6e1569b201607e841"
server_key_iv: "70fbf78e3dad3791dfbad2f3555e69be"
server_key_version: "encryptionkey@0"
I20260808 15:57:05.155292 29295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "3ee2f2073d9747ffbb17d17e97b76d4a"
format_stamp: "Formatted at 2026-08-08 15:57:05 on dist-test-slave-lgr5"
server_key: "53bc25124ec1d4c6e1569b201607e841"
server_key_iv: "70fbf78e3dad3791dfbad2f3555e69be"
server_key_version: "encryptionkey@0"
I20260808 15:57:05.159865 29295 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 15:57:05.162954 29326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:05.164716 29295 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:57:05.164845 29295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "3ee2f2073d9747ffbb17d17e97b76d4a"
format_stamp: "Formatted at 2026-08-08 15:57:05 on dist-test-slave-lgr5"
server_key: "53bc25124ec1d4c6e1569b201607e841"
server_key_iv: "70fbf78e3dad3791dfbad2f3555e69be"
server_key_version: "encryptionkey@0"
I20260808 15:57:05.164968 29295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:05.192870 29295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:05.195845 29295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:05.195987 29295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:05.196561 29295 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:05.197330 29295 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:05.197377 29295 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:05.197417 29295 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:05.197429 29295 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:05.205689 29295 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:34213
I20260808 15:57:05.205749 29507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:34213 every 8 connection(s)
I20260808 15:57:05.206521 29295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:57:05.210793 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 29295
I20260808 15:57:05.210920 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:57:05.211246 19828 external_mini_cluster.cc:1428] Setting key 79960f3864ebfeeccb7cb10a3c2dc26b
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[28866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204625, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:57:05.219847 29005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:05.208200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:46651 (local address 127.19.93.62:43691)
0808 15:57:05.208320 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:05.208324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:05.209107 (+ 783us) server_negotiation.cc:407] Connection header received
0808 15:57:05.210425 (+ 1318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:05.210428 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:05.210476 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:05.210555 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:05.211969 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:05.212580 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:05.213745 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:05.214029 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:05.214142 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:05.216637 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:05.216640 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:05.216642 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:05.216666 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:05.217959 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:05.218427 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:05.218430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:05.218431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:05.218505 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:05.218819 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:05.218823 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:05.218824 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:05.218994 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:05.219078 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:05.219568 (+ 490us) server_negotiation.cc:299] Negotiation successful
0808 15:57:05.219688 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
I20260808 15:57:05.220685 29510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:05.208530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:43691 (local address 127.19.93.2:46651)
0808 15:57:05.208965 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:05.209005 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:05.210245 (+ 1240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:05.210737 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:05.210747 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:05.211224 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:05.211802 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:05.211822 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:05.212699 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:05.212703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:05.213615 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:05.213626 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:05.214161 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:05.214164 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:05.214302 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:05.214895 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:05.214914 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:05.216480 (+ 1566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:05.218076 (+ 1596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:05.218082 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:05.218095 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:05.218332 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:05.218598 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:05.218601 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:05.218603 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:05.218731 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:05.219099 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:05.219106 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:05.219332 (+ 226us) client_negotiation.cc:769] Sending connection context
0808 15:57:05.219492 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 15:57:05.219791 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":115,"threads_started":1}
I20260808 15:57:05.221735 29508 heartbeater.cc:347] Connected to a master server at 127.19.93.62:43691
I20260808 15:57:05.221983 29508 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:05.222441 29508 heartbeater.cc:511] Master 127.19.93.62:43691 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
I20260808 15:57:05.223500 28942 ts_manager.cc:194] Registered new tserver with Master: 3ee2f2073d9747ffbb17d17e97b76d4a (127.19.93.2:34213)
I20260808 15:57:05.224058 28942 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:46651
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 15:57:05.236642 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:43691
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:40249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:05.345408 29513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:05.345635 29513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:05.345679 29513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:05.349592 29513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:05.349643 29513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:05.349720 29513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:57:05.354683 29513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:40249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:43691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:05.355612 29513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:05.356611 29513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:05.365499 29520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:05.365489 29519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:05.365523 29513 server_base.cc:1034] running on GCE node
W20260808 15:57:05.365482 29525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:05.366034 29513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:05.366619 29513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:05.367822 29513 hybrid_clock.cc:648] HybridClock initialized: now 1786204625367803 us; error 29 us; skew 500 ppm
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[28866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204625, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:05.370771 29513 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:57:05.371578 29513 webserver.cc:460] Webserver started at http://127.19.93.3:46095/ using document root <none> and password file <none>
I20260808 15:57:05.372071 29513 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:05.372174 29513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:05.372400 29513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:05.374249 29513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "495ee1a6992846348d5b8a1a91ffc2f7"
format_stamp: "Formatted at 2026-08-08 15:57:05 on dist-test-slave-lgr5"
server_key: "1693dea286613540009c5cd9f8e10671"
server_key_iv: "33b29402a58fe215e4a39eed41f12f54"
server_key_version: "encryptionkey@0"
I20260808 15:57:05.374787 29513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "495ee1a6992846348d5b8a1a91ffc2f7"
format_stamp: "Formatted at 2026-08-08 15:57:05 on dist-test-slave-lgr5"
server_key: "1693dea286613540009c5cd9f8e10671"
server_key_iv: "33b29402a58fe215e4a39eed41f12f54"
server_key_version: "encryptionkey@0"
I20260808 15:57:05.378189 29513 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260808 15:57:05.380426 29534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:05.381567 29513 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:57:05.381669 29513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "495ee1a6992846348d5b8a1a91ffc2f7"
format_stamp: "Formatted at 2026-08-08 15:57:05 on dist-test-slave-lgr5"
server_key: "1693dea286613540009c5cd9f8e10671"
server_key_iv: "33b29402a58fe215e4a39eed41f12f54"
server_key_version: "encryptionkey@0"
I20260808 15:57:05.381754 29513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:05.421554 29513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:05.424376 29513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:05.424561 29513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:05.425151 29513 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:05.425997 29513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:05.426045 29513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:05.426098 29513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:05.426123 29513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:05.434388 29513 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:42601
I20260808 15:57:05.434414 29739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:42601 every 8 connection(s)
I20260808 15:57:05.435250 29513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:57:05.442065 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 29513
I20260808 15:57:05.442178 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:57:05.442482 19828 external_mini_cluster.cc:1428] Setting key 3cb9f488ac4b1f6a2ab676f3d2cb2c5b
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[28866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204625, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:57:05.447726 29005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:05.436961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:58121 (local address 127.19.93.62:43691)
0808 15:57:05.437077 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:05.437081 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:05.437888 (+ 807us) server_negotiation.cc:407] Connection header received
0808 15:57:05.439144 (+ 1256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:05.439147 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:05.439197 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:05.439268 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:05.440447 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:05.441008 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:05.442167 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:05.442503 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:05.442622 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:05.445038 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:05.445041 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:05.445043 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:05.445068 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:05.446147 (+ 1079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:05.446564 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:05.446567 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:05.446568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:05.446635 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:05.446879 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:05.446881 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:05.446882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:05.447038 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:05.447108 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:05.447519 (+ 411us) server_negotiation.cc:299] Negotiation successful
0808 15:57:05.447614 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 15:57:05.448467 29743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:05.437281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:43691 (local address 127.19.93.3:58121)
0808 15:57:05.437727 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:05.437768 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:05.438956 (+ 1188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:05.439409 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:05.439414 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:05.439752 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:05.440315 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:05.440329 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:05.441162 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:05.441165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:05.442034 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:05.442054 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:05.442656 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:05.442659 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:05.442800 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:05.443367 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:05.443386 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:05.444883 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:05.446242 (+ 1359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:05.446246 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:05.446257 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:05.446493 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:05.446695 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:05.446697 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:05.446699 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:05.446815 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:05.447107 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:05.447111 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:05.447315 (+ 204us) client_negotiation.cc:769] Sending connection context
0808 15:57:05.447458 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 15:57:05.447684 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":115,"threads_started":1}
I20260808 15:57:05.449431 29741 heartbeater.cc:347] Connected to a master server at 127.19.93.62:43691
I20260808 15:57:05.449640 29741 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:05.450070 29741 heartbeater.cc:511] Master 127.19.93.62:43691 requested a full tablet report, sending...
I20260808 15:57:05.450977 28942 ts_manager.cc:194] Registered new tserver with Master: 495ee1a6992846348d5b8a1a91ffc2f7 (127.19.93.3:42601)
I20260808 15:57:05.451527 28942 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:58121
I20260808 15:57:05.456105 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/test-admin.keytab.
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[28866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:05.472932 19828 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 15:57:05.475488 29750 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:05.474226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56688 (local address 127.19.93.1:34181)
0808 15:57:05.474500 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:05.474514 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:05.474537 (+ 23us) server_negotiation.cc:407] Connection header received
0808 15:57:05.474584 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:05.474589 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:05.474748 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:05.474861 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:05.475339 (+ 478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56688: BlockingRecv error: recv got EOF from 127.0.0.1:56688 (error 108)
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":93,"threads_started":1}
W20260808 15:57:05.475574 19828 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/krb5cc' of type FILE
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[28866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:05.476543 19828 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[28866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:05.477370 19828 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[28866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.1@KRBTEST.COM
I20260808 15:57:05.486318 29750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:05.478157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56698 (local address 127.19.93.1:34181)
0808 15:57:05.478274 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:05.478278 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:05.478345 (+ 67us) server_negotiation.cc:407] Connection header received
0808 15:57:05.478459 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:05.478461 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:05.478495 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:05.478558 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:05.478984 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:05.479726 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:05.480638 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:05.480976 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:05.481063 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:05.483048 (+ 1985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:05.483057 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:05.483069 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:05.483091 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:05.484582 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:05.485014 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:05.485018 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:05.485019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:05.485104 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:05.485427 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:05.485430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:05.485432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:05.485664 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:05.485805 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:05.486019 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 15:57:05.486174 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 15:57:05.489866 29750 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:05.489034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56714 (local address 127.19.93.1:34181)
0808 15:57:05.489168 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:05.489171 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:05.489234 (+ 63us) server_negotiation.cc:407] Connection header received
0808 15:57:05.489326 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:05.489330 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:05.489368 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:05.489434 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:05.489749 (+ 315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56714: BlockingRecv error: recv got EOF from 127.0.0.1:56714 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260808 15:57:05.489931 19828 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/krb5cc' of type FILE
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[28866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:05.490883 19828 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[28866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:05.491703 19828 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[28866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.1@KRBTEST.COM
I20260808 15:57:05.500424 29750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:05.492534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56720 (local address 127.19.93.1:34181)
0808 15:57:05.492640 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:05.492644 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:05.492741 (+ 97us) server_negotiation.cc:407] Connection header received
0808 15:57:05.492844 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:05.492847 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:05.492889 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:05.492950 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:05.493425 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:05.493935 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:05.494696 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:05.494935 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:05.495022 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:05.497426 (+ 2404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:05.497430 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:05.497433 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:05.497456 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:05.498735 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:05.499199 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:05.499203 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:05.499205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:05.499289 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:05.499559 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:05.499563 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:05.499565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:05.499740 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:05.499872 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:05.500151 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 15:57:05.500263 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 15:57:05.502816 29750 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:05.502084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56726 (local address 127.19.93.1:34181)
0808 15:57:05.502216 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:05.502219 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:05.502249 (+ 30us) server_negotiation.cc:407] Connection header received
0808 15:57:05.502346 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:05.502348 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:05.502387 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:05.502439 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:05.502731 (+ 292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56726: BlockingRecv error: recv got EOF from 127.0.0.1:56726 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260808 15:57:05.503144 19828 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786204595622323-19828-0/krb5kdc/krb5cc)
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[28866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:05.504133 19828 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[28866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:05.504958 19828 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[28866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.1@KRBTEST.COM
I20260808 15:57:05.512938 29750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:05.505734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56742 (local address 127.19.93.1:34181)
0808 15:57:05.505843 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:05.505848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:05.505921 (+ 73us) server_negotiation.cc:407] Connection header received
0808 15:57:05.506033 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:05.506036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:05.506077 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:05.506144 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:05.506634 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:05.507110 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:05.507866 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:05.508123 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:05.508224 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:05.510223 (+ 1999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:05.510228 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:05.510231 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:05.510253 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:05.511387 (+ 1134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:05.511781 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:05.511785 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:05.511787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:05.511871 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:05.512143 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:05.512147 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:05.512149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:05.512333 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:05.512452 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:05.512694 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 15:57:05.512795 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 15:57:05.513854 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 29039
I20260808 15:57:05.523952 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 29295
I20260808 15:57:05.542727 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 29513
I20260808 15:57:05.559427 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 28891
2026-08-08T15:57:05Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2277 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[29773](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[29773](info): set up 2 sockets
Aug 08 15:57:05 dist-test-slave-lgr5 krb5kdc[29773](info): commencing operation
krb5kdc: starting...
W20260808 15:57:06.706715 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:57:06 dist-test-slave-lgr5 krb5kdc[29773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:57:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:57:06Z Disabled control of system clock
WARNING: no policy specified for oryx/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.62.keytab.
Entry for principal oryx/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.62.keytab.
I20260808 15:57:06.820858 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:34947
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.62.keytab
--principal=oryx/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:34947
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:06.928843 29795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:06.929091 29795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:06.929133 29795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:06.933012 29795 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:57:06.933059 29795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:06.933077 29795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:06.933092 29795 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:57:06.933105 29795 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:57:06.938191 29795 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:34947
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.62.keytab
--principal=oryx/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:34947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:06.939137 29795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:06.940100 29795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:57:06.948338 29795 server_base.cc:1034] running on GCE node
W20260808 15:57:06.948259 29802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:06.948282 29801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:06.948264 29807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:06.949051 29795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:06.950093 29795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:06.951236 29795 hybrid_clock.cc:648] HybridClock initialized: now 1786204626951219 us; error 31 us; skew 500 ppm
Aug 08 15:57:06 dist-test-slave-lgr5 krb5kdc[29773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204626, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:06.954082 29795 init.cc:377] Logged in from keytab as oryx/127.19.93.62@KRBTEST.COM (short username oryx)
I20260808 15:57:06.954910 29795 webserver.cc:460] Webserver started at http://127.19.93.62:36713/ using document root <none> and password file <none>
I20260808 15:57:06.955447 29795 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:06.955513 29795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:06.955698 29795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:06.957721 29795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "a1726ee4c74d49c2b802b92782924566"
format_stamp: "Formatted at 2026-08-08 15:57:06 on dist-test-slave-lgr5"
server_key: "6348bb86d936f69aade1d44a1af6f647"
server_key_iv: "44ff27c52e2543e5aae52ad7f89c0479"
server_key_version: "encryptionkey@0"
I20260808 15:57:06.958271 29795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "a1726ee4c74d49c2b802b92782924566"
format_stamp: "Formatted at 2026-08-08 15:57:06 on dist-test-slave-lgr5"
server_key: "6348bb86d936f69aade1d44a1af6f647"
server_key_iv: "44ff27c52e2543e5aae52ad7f89c0479"
server_key_version: "encryptionkey@0"
I20260808 15:57:06.961908 29795 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:57:06.964236 29825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:06.965361 29795 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 15:57:06.965476 29795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "a1726ee4c74d49c2b802b92782924566"
format_stamp: "Formatted at 2026-08-08 15:57:06 on dist-test-slave-lgr5"
server_key: "6348bb86d936f69aade1d44a1af6f647"
server_key_iv: "44ff27c52e2543e5aae52ad7f89c0479"
server_key_version: "encryptionkey@0"
I20260808 15:57:06.965565 29795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:06.975533 29795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:06.978119 29795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:06.978283 29795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:06.984934 29795 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:34947
I20260808 15:57:06.985210 29903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:34947 every 8 connection(s)
I20260808 15:57:06.985852 29795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:57:06.986208 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 29795
I20260808 15:57:06.986353 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:57:06.986654 19828 external_mini_cluster.cc:1428] Setting key 496291acf31cdcb087cbfe6030dcdc6d
I20260808 15:57:06.988924 29904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 15:57:06 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM
I20260808 15:57:06.995205 29904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566: Bootstrap starting.
I20260808 15:57:06.997301 29904 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:06.997984 29904 log.cc:824] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:06.999742 29904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566: No bootstrap required, opened a new log
I20260808 15:57:06.999876 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:06.987909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54076 (local address 127.19.93.62:34947)
0808 15:57:06.988299 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:06.988315 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:06.988350 (+ 35us) server_negotiation.cc:407] Connection header received
0808 15:57:06.988962 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:06.988977 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:06.989314 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:06.989578 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:06.990438 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:06.991405 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:06.992564 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:06.993007 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:06.993128 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:06.995745 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:06.995749 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:06.995761 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:06.995788 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:06.997318 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:06.997724 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:06.997729 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:06.997733 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:06.997842 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:06.998097 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:06.998100 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:06.998102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:06.998465 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:06.998637 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:06.998927 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 15:57:06.999196 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":125,"threads_started":1}
I20260808 15:57:07.003252 29904 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } }
I20260808 15:57:07.003473 29904 raft_consensus.cc:374] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:07.003531 29904 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1726ee4c74d49c2b802b92782924566, State: Initialized, Role: FOLLOWER
I20260808 15:57:07.003950 29904 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } }
I20260808 15:57:07.004101 29904 raft_consensus.cc:388] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:57:07.004168 29904 raft_consensus.cc:482] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:57:07.004263 29904 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:07.005134 29904 raft_consensus.cc:504] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } }
I20260808 15:57:07.005452 29904 leader_election.cc:302] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1726ee4c74d49c2b802b92782924566; no voters:
I20260808 15:57:07.005729 29904 leader_election.cc:288] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:57:07.005829 29911 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:07.006070 29911 raft_consensus.cc:686] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [term 1 LEADER]: Becoming Leader. State: Replica: a1726ee4c74d49c2b802b92782924566, State: Running, Role: LEADER
I20260808 15:57:07.006431 29911 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } }
I20260808 15:57:07.006963 29904 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:57:07.008153 29912 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1726ee4c74d49c2b802b92782924566" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } }
I20260808 15:57:07.008263 29912 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:07.008639 29923 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:57:07.008610 29913 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1726ee4c74d49c2b802b92782924566. Latest consensus state: current_term: 1 leader_uuid: "a1726ee4c74d49c2b802b92782924566" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } }
I20260808 15:57:07.008781 29913 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:07.011349 29923 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:57:07.016688 29923 catalog_manager.cc:1347] Generated new cluster ID: 223a69c248b14254b20b10633e252df1
I20260808 15:57:07.016748 29923 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:57:07.045965 29923 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:57:07.047134 29923 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:57:07.052464 29923 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566: Generated new TSK 0
I20260808 15:57:07.053182 29923 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.1.keytab.
Entry for principal oryx/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.1.keytab.
I20260808 15:57:07.080327 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:34947
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.1.keytab
--principal=oryx/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:07.189535 29940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:07.189765 29940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:07.189802 29940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:07.193622 29940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:07.193666 29940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:07.193718 29940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:57:07.199095 29940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.1.keytab
--principal=oryx/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:34947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:07.199994 29940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:07.200940 29940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:07.210000 29949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:07.210064 29951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:07.210175 29940 server_base.cc:1034] running on GCE node
W20260808 15:57:07.210080 29948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:07.210644 29940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:07.211229 29940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:07.212375 29940 hybrid_clock.cc:648] HybridClock initialized: now 1786204627212359 us; error 28 us; skew 500 ppm
Aug 08 15:57:07 dist-test-slave-lgr5 krb5kdc[29773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204627, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:07.214895 29940 init.cc:377] Logged in from keytab as oryx/127.19.93.1@KRBTEST.COM (short username oryx)
I20260808 15:57:07.215703 29940 webserver.cc:460] Webserver started at http://127.19.93.1:43923/ using document root <none> and password file <none>
I20260808 15:57:07.216246 29940 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:07.216306 29940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:07.216518 29940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:07.218454 29940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "60052020656245e6a11a781e87d219d8"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "44474c6ab5b4481f8f7aa89202c807db"
server_key_iv: "c0348ee76d9f3e1c28c563025a7de727"
server_key_version: "encryptionkey@0"
I20260808 15:57:07.218971 29940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "60052020656245e6a11a781e87d219d8"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "44474c6ab5b4481f8f7aa89202c807db"
server_key_iv: "c0348ee76d9f3e1c28c563025a7de727"
server_key_version: "encryptionkey@0"
I20260808 15:57:07.222424 29940 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:57:07.224633 29964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:07.225778 29940 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:57:07.225890 29940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "60052020656245e6a11a781e87d219d8"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "44474c6ab5b4481f8f7aa89202c807db"
server_key_iv: "c0348ee76d9f3e1c28c563025a7de727"
server_key_version: "encryptionkey@0"
I20260808 15:57:07.225986 29940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:07.249359 29940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:07.251837 29940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:07.251996 29940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:07.252554 29940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:07.253319 29940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:07.253366 29940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:07.253435 29940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:07.253460 29940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:07.261551 29940 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:36971
I20260808 15:57:07.261586 30166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:36971 every 8 connection(s)
I20260808 15:57:07.262356 29940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:57:07.266054 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 29940
I20260808 15:57:07.266155 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:57:07.266466 19828 external_mini_cluster.cc:1428] Setting key 6e6d66409f9e6235a55082b828e22df1
Aug 08 15:57:07 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204627, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM
I20260808 15:57:07.275767 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.264021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:35049 (local address 127.19.93.62:34947)
0808 15:57:07.264184 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:07.264187 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:07.264925 (+ 738us) server_negotiation.cc:407] Connection header received
0808 15:57:07.266283 (+ 1358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:07.266287 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:07.266345 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:07.266434 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:07.267572 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.268249 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.269703 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.270034 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.270148 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.272547 (+ 2399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:07.272551 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:07.272554 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:07.272579 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:07.273913 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.274362 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.274365 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.274367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.274445 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.274744 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.274747 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.274749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.274924 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:07.275008 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:07.275481 (+ 473us) server_negotiation.cc:299] Negotiation successful
0808 15:57:07.275607 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
WARNING: no policy specified for oryx/127.19.93.2@KRBTEST.COM; defaulting to no policy
I20260808 15:57:07.276552 30173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.264363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.1:35049)
0808 15:57:07.264778 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:07.264818 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:07.266014 (+ 1196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:07.266586 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:07.266592 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:07.266921 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:07.267434 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:07.267448 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.268371 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.268374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:07.269592 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:07.269604 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.270179 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.270182 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:07.270317 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.270881 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:07.270899 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:07.272364 (+ 1465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:07.274020 (+ 1656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:07.274026 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:07.274038 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:07.274273 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:07.274526 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:07.274529 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:07.274531 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:07.274659 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:07.275024 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:07.275030 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:07.275257 (+ 227us) client_negotiation.cc:769] Sending connection context
0808 15:57:07.275422 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 15:57:07.275713 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":116,"threads_started":1}
I20260808 15:57:07.277613 30167 heartbeater.cc:347] Connected to a master server at 127.19.93.62:34947
I20260808 15:57:07.277834 30167 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:07.278280 30167 heartbeater.cc:511] Master 127.19.93.62:34947 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.93.2@KRBTEST.COM" created.
I20260808 15:57:07.279841 29854 ts_manager.cc:194] Registered new tserver with Master: 60052020656245e6a11a781e87d219d8 (127.19.93.1:36971)
I20260808 15:57:07.281134 29854 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:35049
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.2.keytab.
Entry for principal oryx/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.2.keytab.
I20260808 15:57:07.292526 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:34947
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.2.keytab
--principal=oryx/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:07.399639 30176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:07.399859 30176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:07.399899 30176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:07.403693 30176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:07.403736 30176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:07.403788 30176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:57:07.408771 30176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.2.keytab
--principal=oryx/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:34947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:07.409670 30176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:07.410570 30176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:07.419663 30188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:07.419656 30185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:07.419708 30176 server_base.cc:1034] running on GCE node
W20260808 15:57:07.419656 30186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:07.420274 30176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:07.420866 30176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:07.422035 30176 hybrid_clock.cc:648] HybridClock initialized: now 1786204627422019 us; error 29 us; skew 500 ppm
Aug 08 15:57:07 dist-test-slave-lgr5 krb5kdc[29773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204627, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:07.424554 30176 init.cc:377] Logged in from keytab as oryx/127.19.93.2@KRBTEST.COM (short username oryx)
I20260808 15:57:07.425344 30176 webserver.cc:460] Webserver started at http://127.19.93.2:36355/ using document root <none> and password file <none>
I20260808 15:57:07.425844 30176 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:07.425907 30176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:07.426126 30176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:07.428040 30176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "2f2255aa9d2040c5a9e4a672000d4b63"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "709c3e59b4df28ab033b3cc87d00fd41"
server_key_iv: "9492ff1254910d5e02643af1d945fc3b"
server_key_version: "encryptionkey@0"
I20260808 15:57:07.428581 30176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "2f2255aa9d2040c5a9e4a672000d4b63"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "709c3e59b4df28ab033b3cc87d00fd41"
server_key_iv: "9492ff1254910d5e02643af1d945fc3b"
server_key_version: "encryptionkey@0"
I20260808 15:57:07.432005 30176 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:57:07.434209 30200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:07.435320 30176 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:07.435425 30176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "2f2255aa9d2040c5a9e4a672000d4b63"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "709c3e59b4df28ab033b3cc87d00fd41"
server_key_iv: "9492ff1254910d5e02643af1d945fc3b"
server_key_version: "encryptionkey@0"
I20260808 15:57:07.435514 30176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:07.457481 30176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:07.459986 30176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:07.460179 30176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:07.460726 30176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:07.461527 30176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:07.461575 30176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:07.461627 30176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:07.461656 30176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:07.469954 30176 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:33589
I20260808 15:57:07.469990 30387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:33589 every 8 connection(s)
I20260808 15:57:07.470809 30176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:57:07.477977 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 30176
I20260808 15:57:07.478085 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:57:07.478358 19828 external_mini_cluster.cc:1428] Setting key 5ab614739ef50281291116e2572ad76b
Aug 08 15:57:07 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204627, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM
I20260808 15:57:07.484377 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.472455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:36987 (local address 127.19.93.62:34947)
0808 15:57:07.472594 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:07.472599 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:07.473414 (+ 815us) server_negotiation.cc:407] Connection header received
0808 15:57:07.474709 (+ 1295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:07.474712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:07.474763 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:07.474844 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:07.475970 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.476627 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.477740 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.477978 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.478077 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.480854 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:07.480858 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:07.480860 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:07.480885 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:07.482327 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.482822 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.482826 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.482828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.482923 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.483280 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.483282 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.483283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.483472 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:07.483549 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:07.484130 (+ 581us) server_negotiation.cc:299] Negotiation successful
0808 15:57:07.484232 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 15:57:07.485426 30392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.472852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.2:36987)
0808 15:57:07.473268 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:07.473308 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:07.474474 (+ 1166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:07.475003 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:07.475010 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:07.475366 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:07.475827 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:07.475841 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.476744 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.476746 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:07.477625 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:07.477635 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.478207 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.478211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:07.478361 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.478928 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:07.478944 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:07.480684 (+ 1740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:07.482473 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:07.482478 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:07.482488 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:07.482731 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:07.483022 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:07.483024 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:07.483026 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:07.483191 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:07.483575 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:07.483582 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:07.483868 (+ 286us) client_negotiation.cc:769] Sending connection context
0808 15:57:07.484068 (+ 200us) client_negotiation.cc:240] Negotiation successful
0808 15:57:07.484403 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":115,"threads_started":1}
I20260808 15:57:07.486562 30388 heartbeater.cc:347] Connected to a master server at 127.19.93.62:34947
I20260808 15:57:07.486817 30388 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:07.487388 30388 heartbeater.cc:511] Master 127.19.93.62:34947 requested a full tablet report, sending...
I20260808 15:57:07.488523 29854 ts_manager.cc:194] Registered new tserver with Master: 2f2255aa9d2040c5a9e4a672000d4b63 (127.19.93.2:33589)
WARNING: no policy specified for oryx/127.19.93.3@KRBTEST.COM; defaulting to no policy
I20260808 15:57:07.489300 29854 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:36987
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.93.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.3.keytab.
Entry for principal oryx/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.3.keytab.
I20260808 15:57:07.504827 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:34947
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.3.keytab
--principal=oryx/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:07.624384 30396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:07.624598 30396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:07.624652 30396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:07.628510 30396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:07.628559 30396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:07.628629 30396 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:57:07.633683 30396 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.3.keytab
--principal=oryx/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:34947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:07.634583 30396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:07.635520 30396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:07.645102 30405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:07.645133 30396 server_base.cc:1034] running on GCE node
W20260808 15:57:07.645324 30403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:07.645340 30402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:07.645840 30396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:07.646591 30396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:07.647782 30396 hybrid_clock.cc:648] HybridClock initialized: now 1786204627647756 us; error 38 us; skew 500 ppm
Aug 08 15:57:07 dist-test-slave-lgr5 krb5kdc[29773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204627, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:07.651029 30396 init.cc:377] Logged in from keytab as oryx/127.19.93.3@KRBTEST.COM (short username oryx)
I20260808 15:57:07.652045 30396 webserver.cc:460] Webserver started at http://127.19.93.3:38371/ using document root <none> and password file <none>
I20260808 15:57:07.652752 30396 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:07.652838 30396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:07.653069 30396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:07.655752 30396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "702abd1878ab40a087fd8116b59f6fbc"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "1dbcc4c7ec5b57bb2ad9f48f30f88db4"
server_key_iv: "e011699022d633d98ce43ed4b4aebe50"
server_key_version: "encryptionkey@0"
I20260808 15:57:07.656420 30396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "702abd1878ab40a087fd8116b59f6fbc"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "1dbcc4c7ec5b57bb2ad9f48f30f88db4"
server_key_iv: "e011699022d633d98ce43ed4b4aebe50"
server_key_version: "encryptionkey@0"
I20260808 15:57:07.661089 30396 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 15:57:07.663942 30415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:07.665347 30396 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:57:07.665482 30396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "702abd1878ab40a087fd8116b59f6fbc"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "1dbcc4c7ec5b57bb2ad9f48f30f88db4"
server_key_iv: "e011699022d633d98ce43ed4b4aebe50"
server_key_version: "encryptionkey@0"
I20260808 15:57:07.665606 30396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:07.679692 30396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:07.682801 30396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:07.682963 30396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:07.683472 30396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:07.684242 30396 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:07.684289 30396 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:07.684340 30396 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:07.684365 30396 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:07.692477 30396 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:43387
I20260808 15:57:07.692569 30607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:43387 every 8 connection(s)
I20260808 15:57:07.693324 30396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:57:07.700443 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 30396
I20260808 15:57:07.700577 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:57:07.700898 19828 external_mini_cluster.cc:1428] Setting key 3796eeedc6717d9100f3dea51ad2a79e
Aug 08 15:57:07 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204627, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM
I20260808 15:57:07.706158 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.695394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:34409 (local address 127.19.93.62:34947)
0808 15:57:07.695565 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:07.695571 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:07.696343 (+ 772us) server_negotiation.cc:407] Connection header received
0808 15:57:07.697665 (+ 1322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:07.697669 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:07.697727 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:07.697827 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:07.698861 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.699368 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.700649 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.700876 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.700965 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.703463 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:07.703467 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:07.703469 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:07.703492 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:07.704613 (+ 1121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.705032 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.705034 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.705035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.705111 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.705349 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.705351 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.705352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.705507 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:07.705577 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:07.705950 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 15:57:07.706047 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:57:07.706877 30611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.695716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.3:34409)
0808 15:57:07.696197 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:07.696247 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:07.697470 (+ 1223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:07.697955 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:07.697978 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:07.698296 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:07.698743 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:07.698757 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.699454 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.699457 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:07.700511 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:07.700523 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.701037 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.701042 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:07.701227 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.701749 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:07.701770 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:07.703322 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:07.704713 (+ 1391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:07.704717 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:07.704727 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:07.704953 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:07.705169 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:07.705171 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:07.705172 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:07.705288 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:07.705574 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:07.705578 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:07.705780 (+ 202us) client_negotiation.cc:769] Sending connection context
0808 15:57:07.705918 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 15:57:07.706136 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":112,"threads_started":1}
I20260808 15:57:07.707892 30608 heartbeater.cc:347] Connected to a master server at 127.19.93.62:34947
I20260808 15:57:07.708130 30608 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:07.708583 30608 heartbeater.cc:511] Master 127.19.93.62:34947 requested a full tablet report, sending...
I20260808 15:57:07.709554 29854 ts_manager.cc:194] Registered new tserver with Master: 702abd1878ab40a087fd8116b59f6fbc (127.19.93.3:43387)
I20260808 15:57:07.710093 29854 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:34409
I20260808 15:57:07.714322 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.19.93.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.93.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.93.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.61.keytab.
Entry for principal oryx/127.19.93.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.61.keytab.
I20260808 15:57:07.740434 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.61:39673
--webserver_interface=127.19.93.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.61.keytab
--principal=oryx/127.19.93.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:34947,127.19.93.61:39673
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:07.848228 30619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:07.848460 30619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:07.848498 30619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:07.852334 30619 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:57:07.852381 30619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:07.852401 30619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:07.852420 30619 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:57:07.852434 30619 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:57:07.857457 30619 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:34947,127.19.93.61:39673
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.61.keytab
--principal=oryx/127.19.93.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.61:39673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.93.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
W20260808 15:57:07.857617 30619 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.93.62:34947,127.19.93.61:39673'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 15:57:07.858335 30619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:07.859200 30619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:07.867062 30626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:07.867074 30631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:07.867075 30627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:07.867301 30619 server_base.cc:1034] running on GCE node
I20260808 15:57:07.867882 30619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:07.868932 30619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:07.870113 30619 hybrid_clock.cc:648] HybridClock initialized: now 1786204627870087 us; error 39 us; skew 500 ppm
Aug 08 15:57:07 dist-test-slave-lgr5 krb5kdc[29773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204627, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:07.872706 30619 init.cc:377] Logged in from keytab as oryx/127.19.93.61@KRBTEST.COM (short username oryx)
I20260808 15:57:07.873466 30619 webserver.cc:460] Webserver started at http://127.19.93.61:37095/ using document root <none> and password file <none>
I20260808 15:57:07.873950 30619 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:07.874004 30619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:07.874172 30619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:07.876133 30619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/data/instance:
uuid: "a49beb7aa14d4812b1bbf79cfa2843c3"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "ef0f4fd0f506e8759de18e63f6f34a03"
server_key_iv: "412d247bb862405ce40a0abe09b9bc85"
server_key_version: "encryptionkey@0"
I20260808 15:57:07.876636 30619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/wal/instance:
uuid: "a49beb7aa14d4812b1bbf79cfa2843c3"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "ef0f4fd0f506e8759de18e63f6f34a03"
server_key_iv: "412d247bb862405ce40a0abe09b9bc85"
server_key_version: "encryptionkey@0"
I20260808 15:57:07.880023 30619 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:57:07.882180 30640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:07.883265 30619 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:07.883379 30619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/wal
uuid: "a49beb7aa14d4812b1bbf79cfa2843c3"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "ef0f4fd0f506e8759de18e63f6f34a03"
server_key_iv: "412d247bb862405ce40a0abe09b9bc85"
server_key_version: "encryptionkey@0"
I20260808 15:57:07.883466 30619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:07.900408 30619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:07.902945 30619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:07.903113 30619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:07.909839 30619 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.61:39673
I20260808 15:57:07.910089 30732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.61:39673 every 8 connection(s)
I20260808 15:57:07.910764 30619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/data/info.pb
I20260808 15:57:07.913429 30734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:07.915894 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 30619
I20260808 15:57:07.917173 30734 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:57:07 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204627, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.61@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM
Aug 08 15:57:07 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.93.61@KRBTEST.COM
I20260808 15:57:07.928505 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.918925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54090 (local address 127.19.93.62:34947)
0808 15:57:07.919075 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:07.919079 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:07.919354 (+ 275us) server_negotiation.cc:407] Connection header received
0808 15:57:07.919598 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:07.919600 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:07.919645 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:07.919710 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:07.920446 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.920971 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.921936 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.922145 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.922230 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.924488 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:07.924491 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:07.924493 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:07.924516 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:07.926058 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.926558 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.926562 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.926564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.926654 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.926989 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.926991 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.926992 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.927273 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:07.927349 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:07.928001 (+ 652us) server_negotiation.cc:299] Negotiation successful
0808 15:57:07.928234 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 15:57:07.929159 30737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.917508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44052 (local address 127.19.93.61:39673)
0808 15:57:07.917918 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:07.917934 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:07.917968 (+ 34us) server_negotiation.cc:407] Connection header received
0808 15:57:07.918597 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:07.918612 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:07.918955 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:07.919274 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:07.920042 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.921004 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.921805 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.922158 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.922332 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.924948 (+ 2616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:07.924955 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:07.924967 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:07.924991 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:07.926611 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.927061 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.927067 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.927068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.927143 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.927376 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.927379 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.927381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.927632 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:07.927798 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:07.928029 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 15:57:07.928292 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":274,"thread_start_us":119,"threads_started":1}
I20260808 15:57:07.929157 30738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.918823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.0.0.1:54090)
0808 15:57:07.919231 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:07.919276 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:07.919456 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:07.919775 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:07.919781 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:07.920128 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:07.920304 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:07.920314 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.921092 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.921094 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:07.921809 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:07.921818 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.922276 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.922280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:07.922436 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.922976 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:07.922991 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:07.924346 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:07.926159 (+ 1813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:07.926167 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:07.926174 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:07.926463 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:07.926738 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:07.926740 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:07.926742 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:07.926904 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:07.927371 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:07.927378 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:07.927671 (+ 293us) client_negotiation.cc:769] Sending connection context
0808 15:57:07.927914 (+ 243us) client_negotiation.cc:240] Negotiation successful
0808 15:57:07.928459 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"mutex_wait_us":141,"thread_start_us":161,"threads_started":1}
I20260808 15:57:07.930500 30734 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:57:07 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204627, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.61@KRBTEST.COM for oryx/127.19.93.61@KRBTEST.COM
I20260808 15:57:07.937309 30738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.930912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:39673 (local address 127.0.0.1:44062)
0808 15:57:07.930995 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:07.931008 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:07.931070 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:07.931262 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:07.931265 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:07.931403 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:07.931484 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:07.931489 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.932115 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.932118 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:07.932600 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:07.932609 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.933442 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.933444 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:07.933519 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.933908 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:07.933919 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:07.934955 (+ 1036us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:07.936288 (+ 1333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:07.936290 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:07.936292 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:07.936460 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:07.936652 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:07.936654 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:07.936655 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:07.936714 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:07.936963 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:07.936965 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:07.937029 (+ 64us) client_negotiation.cc:769] Sending connection context
0808 15:57:07.937100 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 15:57:07.937193 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 15:57:07.937381 30737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.930971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44062 (local address 127.19.93.61:39673)
0808 15:57:07.931064 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:07.931067 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:07.931080 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:57:07.931118 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:07.931120 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:07.931158 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:07.931242 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:07.931573 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.932019 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.932704 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.933340 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.933438 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.935076 (+ 1638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:07.935079 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:07.935081 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:07.935101 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:07.936204 (+ 1103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.936533 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.936535 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.936536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.936595 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.936770 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.936772 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.936773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.936903 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:07.936969 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:07.937138 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 15:57:07.937240 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":39}
I20260808 15:57:07.939839 30734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: Bootstrap starting.
I20260808 15:57:07.941949 30734 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:07.942620 30734 log.cc:824] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:07.944367 30734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: No bootstrap required, opened a new log
I20260808 15:57:07.947135 30734 raft_consensus.cc:348] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } }
I20260808 15:57:07.947314 30734 raft_consensus.cc:374] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:07.947359 30734 raft_consensus.cc:729] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a49beb7aa14d4812b1bbf79cfa2843c3, State: Initialized, Role: FOLLOWER
I20260808 15:57:07.947741 30734 consensus_queue.cc:260] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } }
I20260808 15:57:07.948221 30740 sys_catalog.cc:455] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } } }
I20260808 15:57:07.948346 30740 sys_catalog.cc:458] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:57:07.948875 30734 sys_catalog.cc:564] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 15:57:07.953212 30757 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:57:07.953328 30757 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:57:07.955500 30619 master_runner.cc:428] Detected that this master a49beb7aa14d4812b1bbf79cfa2843c3 is joining an existing cluster
I20260808 15:57:07.955559 30619 master_runner.cc:432] Initiating AddMaster RPC to add 127.19.93.61:39673
I20260808 15:57:07.956892 30740 raft_consensus.cc:482] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:57:07.957036 30740 raft_consensus.cc:504] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } }
I20260808 15:57:07.957769 30740 leader_election.cc:288] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1726ee4c74d49c2b802b92782924566 (127.19.93.62:34947)
I20260808 15:57:07.958334 29871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1726ee4c74d49c2b802b92782924566" is_pre_election: true
I20260808 15:57:07.959033 30642 leader_election.cc:302] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a49beb7aa14d4812b1bbf79cfa2843c3; no voters: a1726ee4c74d49c2b802b92782924566
I20260808 15:57:07.959280 30740 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 15:57:07.966125 30764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.957819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.0.0.1:54104)
0808 15:57:07.958311 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:07.958325 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:07.958475 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:07.958960 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:07.958962 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:07.959450 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:07.959588 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:07.959596 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.960334 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.960337 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:07.961270 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:07.961281 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.961994 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.961997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:07.962091 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.962428 (+ 337us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:07.962443 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:07.962909 (+ 466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:07.964596 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:07.964599 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:07.964601 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:07.964844 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:07.965106 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:07.965109 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:07.965111 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:07.965210 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:07.965619 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:07.965621 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:07.965716 (+ 95us) client_negotiation.cc:769] Sending connection context
0808 15:57:07.965803 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 15:57:07.965934 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"mutex_wait_us":3,"spinlock_wait_cycles":896,"thread_start_us":102,"threads_started":1}
I20260808 15:57:07.966138 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.957824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54104 (local address 127.19.93.62:34947)
0808 15:57:07.957957 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:07.957962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:07.958387 (+ 425us) server_negotiation.cc:407] Connection header received
0808 15:57:07.958610 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:07.958613 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:07.958665 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:07.958717 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:07.959676 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.960227 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.961401 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.961746 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.961855 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.963057 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:07.963061 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:07.963064 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:07.963090 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:07.964510 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.964933 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.964936 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.964938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.965016 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.965309 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.965312 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.965314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.965535 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:07.965633 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:07.965881 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 15:57:07.965990 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:57:07.966663 30768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.958381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:39673 (local address 127.0.0.1:44066)
0808 15:57:07.958695 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:07.958707 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:07.958805 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:07.959088 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:07.959090 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:07.959302 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:07.959435 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:07.959445 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.960524 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.960528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:07.961333 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:07.961341 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.961768 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.961771 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:07.961849 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.962288 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:07.962303 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:07.962719 (+ 416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:07.964516 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:07.964520 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:07.964522 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:07.964836 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:07.965680 (+ 844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:07.965683 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:07.965685 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:07.965771 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:07.966169 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:07.966171 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:07.966242 (+ 71us) client_negotiation.cc:769] Sending connection context
0808 15:57:07.966331 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 15:57:07.966461 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":83,"threads_started":1}
I20260808 15:57:07.966692 30737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.958241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44066 (local address 127.19.93.61:39673)
0808 15:57:07.958319 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:07.958323 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:07.958760 (+ 437us) server_negotiation.cc:407] Connection header received
0808 15:57:07.958884 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:07.958887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:07.958922 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:07.958963 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:07.959551 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.960397 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.961441 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.961664 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.961745 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.962834 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:07.962837 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:07.962840 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:07.962863 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:07.964390 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.965123 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.965126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.965128 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.965212 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.965859 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.965862 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.965864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.966051 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:07.966114 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:07.966395 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 15:57:07.966521 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":33,"spinlock_wait_cycles":33664}
Aug 08 15:57:07 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204626, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.62@KRBTEST.COM for oryx/127.19.93.61@KRBTEST.COM
I20260808 15:57:07.982371 30737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.970726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44068 (local address 127.19.93.61:39673)
0808 15:57:07.970816 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:07.970819 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:07.971673 (+ 854us) server_negotiation.cc:407] Connection header received
0808 15:57:07.971912 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:07.971915 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:07.971963 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:07.972008 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:07.972921 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.973654 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.974912 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.975250 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.975320 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.978687 (+ 3367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:07.978691 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:07.978694 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:07.978721 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:07.980402 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.980870 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.980873 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.980874 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.980964 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:07.981247 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:07.981250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:07.981252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:07.981420 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:07.981514 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:07.982113 (+ 599us) server_negotiation.cc:299] Negotiation successful
0808 15:57:07.982223 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 15:57:07.982419 30769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:07.970711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:39673 (local address 127.0.0.1:44068)
0808 15:57:07.971556 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:07.971606 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:07.971765 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:07.972204 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:07.972209 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:07.972639 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:07.972780 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:07.972788 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.973790 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.973793 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:07.974771 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:07.974781 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:07.975463 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:07.975466 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:07.975588 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:07.976428 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:07.976444 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:07.978523 (+ 2079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:07.980527 (+ 2004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:07.980535 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:07.980541 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:07.980755 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:07.981088 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:07.981090 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:07.981092 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:07.981163 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:07.981536 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:07.981543 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:07.981876 (+ 333us) client_negotiation.cc:769] Sending connection context
0808 15:57:07.982048 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 15:57:07.982243 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":89,"threads_started":1}
I20260808 15:57:07.984004 29854 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.93.61:39673: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3"
member_type: NON_VOTER
last_known_addr {
host: "127.19.93.61"
port: 39673
}
attrs {
promote: true
}
}
dest_uuid: "a1726ee4c74d49c2b802b92782924566"
cas_config_opid_index: -1
I20260808 15:57:07.984802 29854 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: NON_VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: true } }
I20260808 15:57:07.986768 30773 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER a49beb7aa14d4812b1bbf79cfa2843c3 (127.19.93.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: NON_VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: true } } }
I20260808 15:57:07.987507 30686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:07.988790 30773 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.93.61:39673
I20260808 15:57:07.988863 30686 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 FOLLOWER]: Refusing update from remote peer a1726ee4c74d49c2b802b92782924566: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 15:57:07.989193 30619 master.cc:537] Master@127.19.93.61:39673 shutting down...
I20260808 15:57:07.989274 30773 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a1726ee4c74d49c2b802b92782924566" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: NON_VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: true } } }
I20260808 15:57:07.989537 30773 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:07.989707 30773 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: NON_VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 15:57:07.992074 29826 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260808 15:57:07.993070 30619 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:07.993320 30619 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:07.993420 30619 tablet_replica.cc:330] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: stopping tablet replica
I20260808 15:57:07.998777 30619 master.cc:552] Master@127.19.93.61:39673 shutdown complete.
I20260808 15:57:07.998829 30619 master_runner.cc:305] Clearing existing system tablet
I20260808 15:57:07.999053 30619 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:07.999104 30619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:08.000334 30619 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
WARNING: no policy specified for oryx/127.19.93.60@KRBTEST.COM; defaulting to no policy
I20260808 15:57:08.001127 30779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:08.001299 30619 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:08.001412 30619 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 15:57:08.001446 30619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/wal
uuid: "a49beb7aa14d4812b1bbf79cfa2843c3"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "ef0f4fd0f506e8759de18e63f6f34a03"
server_key_iv: "412d247bb862405ce40a0abe09b9bc85"
server_key_version: "encryptionkey@0"
I20260808 15:57:08.003108 30619 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: Deleting tablet data with delete state TABLET_DATA_DELETED
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.93.60@KRBTEST.COM" created.
I20260808 15:57:08.005081 30619 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 15:57:08.005164 30619 log.cc:1196] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 15:57:08.005380 30619 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: Deleting consensus metadata
I20260808 15:57:08.005535 30619 master_runner.cc:315] Copying system tablet from 127.19.93.62:34947
I20260808 15:57:08.006546 30619 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: tablet copy: Beginning tablet copy session from remote peer at address 127.19.93.62:34947
I20260808 15:57:08.008147 30769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.007844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:39673 (local address 127.0.0.1:44074)
0808 15:57:08.007958 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.008029 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:39673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 15:57:08.008299 29826 consensus_peers.cc:487] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 -> Peer a49beb7aa14d4812b1bbf79cfa2843c3 (127.19.93.61:39673): Couldn't send request to peer a49beb7aa14d4812b1bbf79cfa2843c3. Status: Network error: Client connection negotiation failed: client connection to 127.19.93.61:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 15:57:08.014513 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.007378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54120 (local address 127.19.93.62:34947)
0808 15:57:08.007485 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.007489 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.007504 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:57:08.007547 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.007550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.007597 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.007677 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.008304 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.009138 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.010300 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.010517 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.010598 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.011691 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.011694 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.011696 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.011718 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.013035 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.013494 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.013498 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.013500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.013603 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.013848 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.013850 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.013851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.014007 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.014079 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.014318 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.014408 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 15:57:08.014604 30787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.007028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.0.0.1:54120)
0808 15:57:08.007322 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.007339 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.007450 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.007718 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.007721 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.007936 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.008167 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.008177 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.009279 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.009282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.010191 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.010200 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.010617 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.010620 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.010716 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.011159 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.011173 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.011570 (+ 397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.013141 (+ 1571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.013144 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.013147 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.013392 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.013684 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.013687 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.013689 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.013776 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.014081 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.014084 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.014179 (+ 95us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.014281 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.014415 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":89,"threads_started":1}
I20260808 15:57:08.015077 29882 tablet_copy_service.cc:140] P a1726ee4c74d49c2b802b92782924566: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a49beb7aa14d4812b1bbf79cfa2843c3 ({username='oryx', principal='oryx/127.19.93.61@KRBTEST.COM'} at 127.0.0.1:54120)
I20260808 15:57:08.015223 29882 tablet_copy_service.cc:161] P a1726ee4c74d49c2b802b92782924566: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a49beb7aa14d4812b1bbf79cfa2843c3 at {username='oryx', principal='oryx/127.19.93.61@KRBTEST.COM'} at 127.0.0.1:54120: session id = a49beb7aa14d4812b1bbf79cfa2843c3-00000000000000000000000000000000
I20260808 15:57:08.017012 29882 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 15:57:08.018563 30619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 15:57:08.020728 30619 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: tablet copy: Starting download of 0 data blocks...
I20260808 15:57:08.020910 30619 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: tablet copy: Starting download of 1 WAL segments...
I20260808 15:57:08.022614 30619 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 15:57:08.024358 29882 tablet_copy_service.cc:342] P a1726ee4c74d49c2b802b92782924566: Request end of tablet copy session a49beb7aa14d4812b1bbf79cfa2843c3-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.19.93.61@KRBTEST.COM'} at 127.0.0.1:54120
I20260808 15:57:08.024452 29882 tablet_copy_service.cc:433] P a1726ee4c74d49c2b802b92782924566: ending tablet copy session a49beb7aa14d4812b1bbf79cfa2843c3-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a49beb7aa14d4812b1bbf79cfa2843c3
I20260808 15:57:08.030992 30619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:08.032423 30789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.93.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.60.keytab.
Entry for principal oryx/127.19.93.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.60.keytab.
W20260808 15:57:08.032502 30791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:08.033342 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.60:42733
--webserver_interface=127.19.93.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.60.keytab
--principal=oryx/127.19.93.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:34947,127.19.93.61:39673,127.19.93.60:42733
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:57:08.037089 30619 server_base.cc:1034] running on GCE node
W20260808 15:57:08.037189 30794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:08.037420 30619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:08.037721 30619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:08.038808 30619 hybrid_clock.cc:648] HybridClock initialized: now 1786204628038783 us; error 42 us; skew 500 ppm
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:08.040407 30619 init.cc:377] Logged in from keytab as oryx/127.19.93.61@KRBTEST.COM (short username oryx)
I20260808 15:57:08.040841 30619 webserver.cc:460] Webserver started at http://127.19.93.61:35309/ using document root <none> and password file <none>
I20260808 15:57:08.041031 30619 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:08.041070 30619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:08.042359 30619 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 15:57:08.043313 30804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:08.043550 30619 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 15:57:08.043622 30619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/wal
uuid: "a49beb7aa14d4812b1bbf79cfa2843c3"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "ef0f4fd0f506e8759de18e63f6f34a03"
server_key_iv: "412d247bb862405ce40a0abe09b9bc85"
server_key_version: "encryptionkey@0"
I20260808 15:57:08.043691 30619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:08.065378 30619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:08.067346 30619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:08.072448 30619 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.61:39673
I20260808 15:57:08.073063 30619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-1/data/info.pb
I20260808 15:57:08.074820 30906 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:57:08.075870 30906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: Bootstrap starting.
I20260808 15:57:08.076264 30904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.61:39673 every 8 connection(s)
I20260808 15:57:08.086035 30906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:57:08.086325 30906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: Bootstrap complete.
I20260808 15:57:08.086889 30906 raft_consensus.cc:348] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: NON_VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: true } }
I20260808 15:57:08.087023 30906 raft_consensus.cc:729] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a49beb7aa14d4812b1bbf79cfa2843c3, State: Initialized, Role: LEARNER
I20260808 15:57:08.087123 30906 consensus_queue.cc:260] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: NON_VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: true } }
I20260808 15:57:08.087436 30911 sys_catalog.cc:455] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: NON_VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: true } } }
I20260808 15:57:08.087568 30906 sys_catalog.cc:564] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:57:08.087615 30911 sys_catalog.cc:458] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: This master's current role is: LEARNER
I20260808 15:57:08.091166 30927 catalog_manager.cc:1259] Loaded cluster ID: 223a69c248b14254b20b10633e252df1
I20260808 15:57:08.091226 30927 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: loading cluster ID for follower catalog manager: success
I20260808 15:57:08.093355 30927 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: acquiring CA information for follower catalog manager: success
I20260808 15:57:08.094712 30927 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 15:57:08.151914 30795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:08.152182 30795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:08.152253 30795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:08.156164 30795 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:57:08.156212 30795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:08.156239 30795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:08.156268 30795 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:57:08.156296 30795 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:57:08.161321 30795 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:34947,127.19.93.61:39673,127.19.93.60:42733
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.60.keytab
--principal=oryx/127.19.93.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.60:42733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.93.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:08.162261 30795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:08.163184 30795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:08.171139 30940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:08.171137 30936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:08.171298 30795 server_base.cc:1034] running on GCE node
W20260808 15:57:08.171171 30938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:08.172008 30795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:08.173065 30795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:08.174223 30795 hybrid_clock.cc:648] HybridClock initialized: now 1786204628174200 us; error 29 us; skew 500 ppm
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:08.176832 30795 init.cc:377] Logged in from keytab as oryx/127.19.93.60@KRBTEST.COM (short username oryx)
I20260808 15:57:08.177713 30795 webserver.cc:460] Webserver started at http://127.19.93.60:38661/ using document root <none> and password file <none>
I20260808 15:57:08.178220 30795 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:08.178283 30795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:08.178460 30795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:08.180437 30795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/data/instance:
uuid: "277b1e52bfc24312a52d5342cf887252"
format_stamp: "Formatted at 2026-08-08 15:57:08 on dist-test-slave-lgr5"
server_key: "62940fd71b8a12c179eb50e7e7fe8bc1"
server_key_iv: "0a71a4257eedf870bd3b92cdc6b33547"
server_key_version: "encryptionkey@0"
I20260808 15:57:08.180949 30795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/wal/instance:
uuid: "277b1e52bfc24312a52d5342cf887252"
format_stamp: "Formatted at 2026-08-08 15:57:08 on dist-test-slave-lgr5"
server_key: "62940fd71b8a12c179eb50e7e7fe8bc1"
server_key_iv: "0a71a4257eedf870bd3b92cdc6b33547"
server_key_version: "encryptionkey@0"
I20260808 15:57:08.184360 30795 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:57:08.186589 30948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:08.187673 30795 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:08.187781 30795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/wal
uuid: "277b1e52bfc24312a52d5342cf887252"
format_stamp: "Formatted at 2026-08-08 15:57:08 on dist-test-slave-lgr5"
server_key: "62940fd71b8a12c179eb50e7e7fe8bc1"
server_key_iv: "0a71a4257eedf870bd3b92cdc6b33547"
server_key_version: "encryptionkey@0"
I20260808 15:57:08.187866 30795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:08.197009 30795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:08.199754 30795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:08.199911 30795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:08.206295 30795 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.60:42733
I20260808 15:57:08.206528 31030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.60:42733 every 8 connection(s)
I20260808 15:57:08.207175 30795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/data/info.pb
I20260808 15:57:08.209755 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 30795
I20260808 15:57:08.209867 31035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:08.214270 31035 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.93.60@KRBTEST.COM
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.60@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM
I20260808 15:57:08.224669 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.216140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54122 (local address 127.19.93.62:34947)
0808 15:57:08.216270 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.216274 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.216484 (+ 210us) server_negotiation.cc:407] Connection header received
0808 15:57:08.216610 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.216613 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.216664 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.216739 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.217474 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.218272 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.219266 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.219499 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.219577 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.221556 (+ 1979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.221560 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.221563 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.221590 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.222980 (+ 1390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.223427 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.223429 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.223430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.223500 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.223770 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.223774 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.223776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.223982 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.224104 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.224411 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.224516 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 15:57:08.224846 31040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.215997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.0.0.1:54122)
0808 15:57:08.216375 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.216412 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.216522 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.216799 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.216804 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.217211 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.217345 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.217351 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.218387 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.218390 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.219151 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.219161 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.219618 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.219620 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.219698 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.220155 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.220167 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.221405 (+ 1238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.223069 (+ 1664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.223076 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.223081 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.223330 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.223591 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.223594 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.223596 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.223687 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.224113 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.224119 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.224224 (+ 105us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.224337 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.224503 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":157,"threads_started":1}
I20260808 15:57:08.224846 31038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.211075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45868 (local address 127.19.93.60:42733)
0808 15:57:08.211471 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.211487 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.211519 (+ 32us) server_negotiation.cc:407] Connection header received
0808 15:57:08.212284 (+ 765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.212302 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.212620 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.212873 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.213743 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.214727 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.215847 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.216532 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.216714 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.219692 (+ 2978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.219697 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.219706 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.219728 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.221876 (+ 2148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.222530 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.222536 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.222541 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.222675 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.222983 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.222985 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.222986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.223465 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.223612 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.223870 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.224142 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"spinlock_wait_cycles":5888,"thread_start_us":102,"threads_started":1}
I20260808 15:57:08.226068 31035 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.60@KRBTEST.COM for oryx/127.19.93.61@KRBTEST.COM
I20260808 15:57:08.233916 31040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.226462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:39673 (local address 127.0.0.1:44088)
0808 15:57:08.226820 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.226833 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.226903 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.227122 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.227124 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.227238 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.227317 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.227321 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.228130 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.228133 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.228628 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.228635 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.229057 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.229061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.229132 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.229507 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.229517 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.230721 (+ 1204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.232451 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.232454 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.232457 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.232675 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.232958 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.232961 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.232963 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.233047 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.233424 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.233428 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.233520 (+ 92us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.233615 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.233739 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296}
I20260808 15:57:08.233973 31041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.226602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44088 (local address 127.19.93.61:39673)
0808 15:57:08.226860 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.226865 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.226881 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:57:08.226989 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.226993 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.227037 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.227104 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.227416 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.228033 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.228714 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.228960 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.229048 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.230877 (+ 1829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.230880 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.230882 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.230906 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.232301 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.232774 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.232778 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.232779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.232864 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.233133 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.233137 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.233139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.233327 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.233423 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.233681 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.233800 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":91,"threads_started":1}
I20260808 15:57:08.234691 31035 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.60@KRBTEST.COM for oryx/127.19.93.60@KRBTEST.COM
I20260808 15:57:08.241888 31040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.235083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:42733 (local address 127.0.0.1:45878)
0808 15:57:08.235193 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.235208 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.235286 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.235484 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.235486 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.235632 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.235693 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.235699 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.236445 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.236449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.236937 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.236945 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.237824 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.237828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.237902 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.238259 (+ 357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.238275 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.239381 (+ 1106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.240770 (+ 1389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.240772 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.240773 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.240942 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.241153 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.241155 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.241157 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.241227 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.241546 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.241548 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.241616 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.241683 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.241793 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 15:57:08.242038 31038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.235146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45878 (local address 127.19.93.60:42733)
0808 15:57:08.235234 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.235238 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.235252 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:57:08.235358 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.235361 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.235396 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.235462 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.235797 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.236332 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.237053 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.237708 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.237807 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.239496 (+ 1689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.239499 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.239501 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.239523 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.240679 (+ 1156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.241015 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.241017 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.241018 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.241086 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.241291 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.241293 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.241294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.241467 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.241540 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.241731 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.241867 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":35}
I20260808 15:57:08.244630 31035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: Bootstrap starting.
I20260808 15:57:08.246723 31035 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:08.247395 31035 log.cc:824] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:08.249082 31035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: No bootstrap required, opened a new log
I20260808 15:57:08.251827 31035 raft_consensus.cc:348] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } }
I20260808 15:57:08.252014 31035 raft_consensus.cc:374] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:08.252071 31035 raft_consensus.cc:729] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 277b1e52bfc24312a52d5342cf887252, State: Initialized, Role: FOLLOWER
I20260808 15:57:08.252508 31035 consensus_queue.cc:260] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } }
I20260808 15:57:08.252950 31045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } } }
I20260808 15:57:08.253068 31045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:57:08.253631 31035 sys_catalog.cc:564] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 15:57:08.257953 31066 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:57:08.258034 31066 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:57:08.260846 30795 master_runner.cc:428] Detected that this master 277b1e52bfc24312a52d5342cf887252 is joining an existing cluster
I20260808 15:57:08.260895 30795 master_runner.cc:432] Initiating AddMaster RPC to add 127.19.93.60:42733
I20260808 15:57:08.271867 31075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.263141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:39673 (local address 127.0.0.1:44098)
0808 15:57:08.263396 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.263409 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.263490 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.263802 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.263805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.264010 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.264373 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.264380 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.265388 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.265391 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.266348 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.266357 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.267035 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.267038 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.267153 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.268182 (+ 1029us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.268196 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.268514 (+ 318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.270276 (+ 1762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.270279 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.270282 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.270517 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.270780 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.270783 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.270784 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.270890 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.271355 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.271358 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.271457 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.271582 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.271686 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":4,"thread_start_us":80,"threads_started":1}
I20260808 15:57:08.272182 31041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.263473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44098 (local address 127.19.93.61:39673)
0808 15:57:08.263601 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.263605 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.263616 (+ 11us) server_negotiation.cc:407] Connection header received
0808 15:57:08.263651 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.263653 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.263699 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.263768 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.264495 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.265257 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.266474 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.266809 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.266875 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.268664 (+ 1789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.268667 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.268669 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.268690 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.270191 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.270606 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.270609 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.270611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.270687 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.271046 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.271049 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.271051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.271261 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.271356 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.271872 (+ 516us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.272011 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 15:57:08.273953 31038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.266126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45884 (local address 127.19.93.60:42733)
0808 15:57:08.266216 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.266220 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.266514 (+ 294us) server_negotiation.cc:407] Connection header received
0808 15:57:08.266645 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.266648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.266680 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.266722 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.267583 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.268015 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.269155 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.269467 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.269531 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.270785 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.270788 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.270791 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.270810 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.272424 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.272864 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.272867 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.272870 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.272961 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.273218 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.273221 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.273223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.273389 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.273450 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.273735 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.273855 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":35}
I20260808 15:57:08.273989 31076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.266109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:42733 (local address 127.0.0.1:45884)
0808 15:57:08.266436 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.266448 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.266563 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.266837 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.266840 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.267033 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.267463 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.267474 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.268148 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.268151 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.269000 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.269012 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.269651 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.269654 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.269745 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.270231 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.270246 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.270661 (+ 415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.272519 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.272522 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.272524 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.272751 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.273053 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.273055 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.273057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.273143 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.273503 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.273506 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.273587 (+ 81us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.273680 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.273806 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":51,"thread_start_us":87,"threads_started":1}
I20260808 15:57:08.277943 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 29940
I20260808 15:57:08.289113 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.264003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54136 (local address 127.19.93.62:34947)
0808 15:57:08.264169 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.264174 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.264187 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:57:08.264222 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.264224 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.264265 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.264339 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.264903 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.265620 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.266674 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.266972 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.267070 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.285250 (+ 18180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.285254 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.285257 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.285288 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.286908 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.287375 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.287378 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.287380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.287460 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.287836 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.287839 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.287841 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.288068 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.288193 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.288828 (+ 635us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.288956 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 15:57:08.289479 31074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.262738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.0.0.1:54136)
0808 15:57:08.262998 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.263012 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.263102 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.264442 (+ 1340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.264445 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.264665 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.264775 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.264781 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.265736 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.265739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.266560 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.266568 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.267180 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.267184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.267259 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.284607 (+ 17348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.284622 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.285064 (+ 442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.287038 (+ 1974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.287042 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.287044 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.287272 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.287556 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.287559 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.287561 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.287693 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.288236 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.288239 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.288382 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.288481 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.288619 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":92,"threads_started":1}
I20260808 15:57:08.303752 31045 raft_consensus.cc:482] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:57:08.303911 31045 raft_consensus.cc:504] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } }
I20260808 15:57:08.304893 31045 leader_election.cc:288] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1726ee4c74d49c2b802b92782924566 (127.19.93.62:34947), a49beb7aa14d4812b1bbf79cfa2843c3 (127.19.93.61:39673)
I20260808 15:57:08.307768 30838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "277b1e52bfc24312a52d5342cf887252" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" is_pre_election: true
I20260808 15:57:08.307940 29871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "277b1e52bfc24312a52d5342cf887252" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1726ee4c74d49c2b802b92782924566" is_pre_election: true
I20260808 15:57:08.308025 30838 raft_consensus.cc:1799] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 LEARNER]: Handling vote request from an unknown peer 277b1e52bfc24312a52d5342cf887252
I20260808 15:57:08.308199 30838 raft_consensus.cc:2396] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 LEARNER]: Leader pre-election vote request: Denying vote to candidate 277b1e52bfc24312a52d5342cf887252 for term 1 because replica has last-logged OpId of term: 1 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260808 15:57:08.308960 30949 leader_election.cc:302] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 277b1e52bfc24312a52d5342cf887252; no voters: a1726ee4c74d49c2b802b92782924566, a49beb7aa14d4812b1bbf79cfa2843c3
I20260808 15:57:08.309458 31045 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:08.310874 31045 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 15:57:08.311599 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:36971
--local_ip_for_outbound_sockets=127.19.93.1
--tserver_master_addrs=127.19.93.62:34947
--webserver_port=43923
--webserver_interface=127.19.93.1
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.1.keytab
--principal=oryx/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.93.62:34947,127.19.93.61:39673
--tserver_master_addrs=127.19.93.62:34947,127.19.93.61:39673,127.19.93.60:42733 with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204626, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.62@KRBTEST.COM for oryx/127.19.93.60@KRBTEST.COM
I20260808 15:57:08.317090 31038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.306957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45894 (local address 127.19.93.60:42733)
0808 15:57:08.307078 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.307084 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.307100 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:57:08.307178 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.307181 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.307244 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.307320 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.308950 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.309654 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.310894 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.311249 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.311361 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.313564 (+ 2203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.313568 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.313571 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.313597 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.315158 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.315729 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.315733 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.315735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.315835 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.316187 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.316191 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.316193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.316398 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.316492 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.316817 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.316943 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 15:57:08.317097 30769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.300102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:42733 (local address 127.0.0.1:45894)
0808 15:57:08.304341 (+ 4239us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.304359 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.304458 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.308301 (+ 3843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.308317 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.308533 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.308661 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.308670 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.309916 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.309920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.310723 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.310737 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.311365 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.311369 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.311464 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.312002 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.312015 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.313397 (+ 1382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.315286 (+ 1889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.315290 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.315292 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.315591 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.315950 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.315953 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.315955 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.316052 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.316509 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.316513 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.316633 (+ 120us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.316752 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.316906 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4139}
I20260808 15:57:08.318234 29854 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.93.60:42733: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "277b1e52bfc24312a52d5342cf887252"
member_type: NON_VOTER
last_known_addr {
host: "127.19.93.60"
port: 42733
}
attrs {
promote: true
}
}
dest_uuid: "a1726ee4c74d49c2b802b92782924566"
cas_config_opid_index: 5
I20260808 15:57:08.318934 29854 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: NON_VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: true } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } }
I20260808 15:57:08.320204 30772 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 277b1e52bfc24312a52d5342cf887252 (127.19.93.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: NON_VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: true } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } } }
I20260808 15:57:08.321591 30772 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.93.60:42733
I20260808 15:57:08.321756 30772 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a1726ee4c74d49c2b802b92782924566" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: NON_VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: true } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } } }
I20260808 15:57:08.321841 30772 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:08.322974 30983 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 1 FOLLOWER]: Refusing update from remote peer a1726ee4c74d49c2b802b92782924566: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 15:57:08.323659 30795 master.cc:537] Master@127.19.93.60:42733 shutting down...
I20260808 15:57:08.324012 30772 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [LEADER]: Connected to new peer: Peer: permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:08.326104 30769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.320446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:39673 (local address 127.0.0.1:44114)
0808 15:57:08.320927 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.320942 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.321035 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.321530 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.321534 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.321555 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:08.321643 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.321651 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.322746 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.322750 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.323971 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.323986 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.325447 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.325451 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.325561 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.325611 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.325867 (+ 256us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.325951 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410}
W20260808 15:57:08.326366 29829 consensus_peers.cc:487] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 -> Peer 277b1e52bfc24312a52d5342cf887252 (127.19.93.60:42733): Couldn't send request to peer 277b1e52bfc24312a52d5342cf887252. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 15:57:08.326556 31041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.320704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44114 (local address 127.19.93.61:39673)
0808 15:57:08.320833 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.320839 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.321131 (+ 292us) server_negotiation.cc:407] Connection header received
0808 15:57:08.321191 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.321194 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.321265 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.321381 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:08.321815 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.322588 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.324154 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.325053 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.325160 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.325360 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.326335 (+ 975us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.326426 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 15:57:08.326998 30838 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 LEARNER]: Refusing update from remote peer a1726ee4c74d49c2b802b92782924566: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 15:57:08.327445 30772 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: NON_VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 15:57:08.329100 30795 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:08.329398 30795 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:08.329537 30795 tablet_replica.cc:330] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: stopping tablet replica
I20260808 15:57:08.329413 30838 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 277b1e52bfc24312a52d5342cf887252 (127.19.93.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: NON_VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: true } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } } }
I20260808 15:57:08.331274 30911 sys_catalog.cc:455] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1726ee4c74d49c2b802b92782924566. Latest consensus state: current_term: 1 leader_uuid: "a1726ee4c74d49c2b802b92782924566" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: NON_VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: true } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } } }
I20260808 15:57:08.331414 30911 sys_catalog.cc:458] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: This master's current role is: LEARNER
I20260808 15:57:08.331497 30911 sys_catalog.cc:455] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a1726ee4c74d49c2b802b92782924566" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: NON_VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: true } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } } }
I20260808 15:57:08.331568 30911 sys_catalog.cc:458] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: This master's current role is: LEARNER
I20260808 15:57:08.333022 30772 raft_consensus.cc:1050] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566: attempting to promote NON_VOTER a49beb7aa14d4812b1bbf79cfa2843c3 to VOTER
I20260808 15:57:08.333477 30772 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } }
I20260808 15:57:08.334762 30838 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 LEARNER]: Refusing update from remote peer a1726ee4c74d49c2b802b92782924566: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 15:57:08.335335 30769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.335121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:42733 (local address 127.0.0.1:45902)
0808 15:57:08.335212 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.335268 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:42733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 15:57:08.335424 30795 master.cc:552] Master@127.19.93.60:42733 shutdown complete.
I20260808 15:57:08.335460 30795 master_runner.cc:305] Clearing existing system tablet
I20260808 15:57:08.335584 31083 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 15:57:08.335698 30795 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:08.335758 30795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:08.336032 30769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.335806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:42733 (local address 127.0.0.1:45904)
0808 15:57:08.335921 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.335970 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:42733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 15:57:08.336150 29829 consensus_peers.cc:487] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 -> Peer 277b1e52bfc24312a52d5342cf887252 (127.19.93.60:42733): Couldn't send request to peer 277b1e52bfc24312a52d5342cf887252. Status: Network error: Client connection negotiation failed: client connection to 127.19.93.60:42733: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 15:57:08.337116 30795 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 15:57:08.337808 30773 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, a49beb7aa14d4812b1bbf79cfa2843c3 (127.19.93.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } } }
I20260808 15:57:08.339320 30773 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a1726ee4c74d49c2b802b92782924566" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } } }
I20260808 15:57:08.339452 30773 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:08.339597 30773 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a1726ee4c74d49c2b802b92782924566" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } } }
I20260808 15:57:08.339668 30773 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:08.340039 30838 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, a49beb7aa14d4812b1bbf79cfa2843c3 (127.19.93.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } } }
I20260808 15:57:08.340432 31085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:08.340653 30795 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:08.340771 30795 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 15:57:08.340803 30795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/wal
uuid: "277b1e52bfc24312a52d5342cf887252"
format_stamp: "Formatted at 2026-08-08 15:57:08 on dist-test-slave-lgr5"
server_key: "62940fd71b8a12c179eb50e7e7fe8bc1"
server_key_iv: "0a71a4257eedf870bd3b92cdc6b33547"
server_key_version: "encryptionkey@0"
I20260808 15:57:08.341675 31082 sys_catalog.cc:455] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a1726ee4c74d49c2b802b92782924566" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } } }
I20260808 15:57:08.341812 31082 sys_catalog.cc:458] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:57:08.342612 30795 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:08.344471 30795 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 15:57:08.344559 30795 log.cc:1196] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 15:57:08.344772 30795 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: Deleting consensus metadata
I20260808 15:57:08.344926 30795 master_runner.cc:315] Copying system tablet from 127.19.93.62:34947
I20260808 15:57:08.345896 30795 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: tablet copy: Beginning tablet copy session from remote peer at address 127.19.93.62:34947
I20260808 15:57:08.353041 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.346480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54144 (local address 127.19.93.62:34947)
0808 15:57:08.346581 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.346585 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.346770 (+ 185us) server_negotiation.cc:407] Connection header received
0808 15:57:08.346872 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.346875 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.346935 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.346998 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.347413 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.348033 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.348925 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.349147 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.349233 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.350257 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.350260 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.350263 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.350286 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.351560 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.351947 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.351951 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.351952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.352024 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.352290 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.352293 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.352295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.352470 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.352555 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.352800 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.352901 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 15:57:08.353056 31095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.346341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.0.0.1:54144)
0808 15:57:08.346685 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.346696 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.346800 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.347031 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.347034 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.347221 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.347311 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.347317 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.348240 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.348244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.348803 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.348813 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.349246 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.349250 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.349345 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.349805 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.349816 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.350128 (+ 312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.351661 (+ 1533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.351665 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.351667 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.351862 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.352124 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.352127 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.352129 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.352211 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.352560 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.352563 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.352654 (+ 91us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.352738 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.352881 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":80,"threads_started":1}
I20260808 15:57:08.353649 29882 tablet_copy_service.cc:140] P a1726ee4c74d49c2b802b92782924566: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 277b1e52bfc24312a52d5342cf887252 ({username='oryx', principal='oryx/127.19.93.60@KRBTEST.COM'} at 127.0.0.1:54144)
I20260808 15:57:08.353729 29882 tablet_copy_service.cc:161] P a1726ee4c74d49c2b802b92782924566: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 277b1e52bfc24312a52d5342cf887252 at {username='oryx', principal='oryx/127.19.93.60@KRBTEST.COM'} at 127.0.0.1:54144: session id = 277b1e52bfc24312a52d5342cf887252-00000000000000000000000000000000
I20260808 15:57:08.354657 29882 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 15:57:08.355772 30795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 15:57:08.357802 30795 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: tablet copy: Starting download of 0 data blocks...
I20260808 15:57:08.357964 30795 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: tablet copy: Starting download of 1 WAL segments...
I20260808 15:57:08.359169 30795 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 15:57:08.360587 29882 tablet_copy_service.cc:342] P a1726ee4c74d49c2b802b92782924566: Request end of tablet copy session 277b1e52bfc24312a52d5342cf887252-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.19.93.60@KRBTEST.COM'} at 127.0.0.1:54144
I20260808 15:57:08.360662 29882 tablet_copy_service.cc:433] P a1726ee4c74d49c2b802b92782924566: ending tablet copy session 277b1e52bfc24312a52d5342cf887252-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 277b1e52bfc24312a52d5342cf887252
I20260808 15:57:08.366967 30795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:08.368584 31100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:08.368774 31097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:08.368880 31096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:08.369114 30795 server_base.cc:1034] running on GCE node
I20260808 15:57:08.369256 30795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:08.369536 30795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:08.370662 30795 hybrid_clock.cc:648] HybridClock initialized: now 1786204628370652 us; error 26 us; skew 500 ppm
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:08.372008 30795 init.cc:377] Logged in from keytab as oryx/127.19.93.60@KRBTEST.COM (short username oryx)
I20260808 15:57:08.372442 30795 webserver.cc:460] Webserver started at http://127.19.93.60:36711/ using document root <none> and password file <none>
I20260808 15:57:08.372613 30795 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:08.372646 30795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:08.373605 30795 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 15:57:08.374393 31112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:08.374603 30795 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 15:57:08.374670 30795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/wal
uuid: "277b1e52bfc24312a52d5342cf887252"
format_stamp: "Formatted at 2026-08-08 15:57:08 on dist-test-slave-lgr5"
server_key: "62940fd71b8a12c179eb50e7e7fe8bc1"
server_key_iv: "0a71a4257eedf870bd3b92cdc6b33547"
server_key_version: "encryptionkey@0"
I20260808 15:57:08.374747 30795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:08.384282 30795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:08.385910 30795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:08.390591 30795 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.60:42733
I20260808 15:57:08.390614 31194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.60:42733 every 8 connection(s)
I20260808 15:57:08.391069 30795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/master-2/data/info.pb
I20260808 15:57:08.392575 31195 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:57:08.393357 31195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: Bootstrap starting.
I20260808 15:57:08.401517 31195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:57:08.401747 31195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: Bootstrap complete.
I20260808 15:57:08.402185 31195 raft_consensus.cc:348] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } }
I20260808 15:57:08.402297 31195 raft_consensus.cc:729] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 277b1e52bfc24312a52d5342cf887252, State: Initialized, Role: LEARNER
I20260808 15:57:08.402398 31195 consensus_queue.cc:260] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } }
I20260808 15:57:08.402688 31204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } } }
I20260808 15:57:08.402812 31195 sys_catalog.cc:564] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:57:08.402863 31204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [sys.catalog]: This master's current role is: LEARNER
I20260808 15:57:08.405714 31218 catalog_manager.cc:1259] Loaded cluster ID: 223a69c248b14254b20b10633e252df1
I20260808 15:57:08.405817 31218 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: loading cluster ID for follower catalog manager: success
I20260808 15:57:08.407490 31218 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: acquiring CA information for follower catalog manager: success
I20260808 15:57:08.408723 31218 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 15:57:08.460808 31077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:08.461035 31077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:08.461073 31077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:08.464932 31077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:08.464977 31077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:08.465031 31077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:57:08.470098 31077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.1.keytab
--principal=oryx/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:36971
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=43923
--tserver_master_addrs=127.19.93.62:34947,127.19.93.61:39673,127.19.93.60:42733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:08.471246 31077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:08.472465 31077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:08.482261 31226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:08.482283 31227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:08.482262 31229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:08.482692 31077 server_base.cc:1034] running on GCE node
I20260808 15:57:08.483088 31077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:08.483669 31077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:08.484817 31077 hybrid_clock.cc:648] HybridClock initialized: now 1786204628484805 us; error 24 us; skew 500 ppm
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:08.487435 31077 init.cc:377] Logged in from keytab as oryx/127.19.93.1@KRBTEST.COM (short username oryx)
I20260808 15:57:08.488358 31077 webserver.cc:460] Webserver started at http://127.19.93.1:43923/ using document root <none> and password file <none>
I20260808 15:57:08.488924 31077 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:08.489008 31077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:08.491216 30388 heartbeater.cc:503] Master 127.19.93.62:34947 was elected leader, sending a full tablet report...
I20260808 15:57:08.492937 31077 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:57:08.494837 31242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:08.495966 31077 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 15:57:08.496101 31077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "60052020656245e6a11a781e87d219d8"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "44474c6ab5b4481f8f7aa89202c807db"
server_key_iv: "c0348ee76d9f3e1c28c563025a7de727"
server_key_version: "encryptionkey@0"
I20260808 15:57:08.496614 31077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:08.517649 31077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:08.520319 31077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:08.520479 31077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:08.521009 31077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:08.521817 31077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:08.521864 31077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:08.521914 31077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:08.521939 31077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:08.530833 31077 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:36971
I20260808 15:57:08.530869 31433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:36971 every 8 connection(s)
I20260808 15:57:08.531739 31077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:57:08.538784 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 31077
I20260808 15:57:08.538997 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 30176
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.60@KRBTEST.COM
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.61@KRBTEST.COM
I20260808 15:57:08.549942 31442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.533451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:52431 (local address 127.19.93.60:42733)
0808 15:57:08.533709 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.533713 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.534576 (+ 863us) server_negotiation.cc:407] Connection header received
0808 15:57:08.535629 (+ 1053us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.535633 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.535693 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.535773 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.537016 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.538065 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.539188 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.539561 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.539651 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.544812 (+ 5161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.544817 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.544820 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.544853 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.547052 (+ 2199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.547909 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.547913 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.547915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.548034 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.548924 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.548928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.548929 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.549146 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.549211 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.549631 (+ 420us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.549767 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":90,"threads_started":1}
I20260808 15:57:08.550027 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.535158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:59437 (local address 127.19.93.62:34947)
0808 15:57:08.535304 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.535309 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.535325 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:57:08.535647 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.535650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.535702 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.535752 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.537046 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.537848 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.539150 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.539498 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.539572 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.544718 (+ 5146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.544722 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.544725 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.544751 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.546847 (+ 2096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.547721 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.547726 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.547729 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.547844 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.548418 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.548423 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.548425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.548706 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.548797 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.549675 (+ 878us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.549831 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:57:08.550367 31041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.533451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:55907 (local address 127.19.93.61:39673)
0808 15:57:08.533584 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.533588 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.534970 (+ 1382us) server_negotiation.cc:407] Connection header received
0808 15:57:08.535647 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.535650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.535705 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.535752 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.537037 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.537561 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.539163 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.539497 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.539579 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.547158 (+ 7579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.547162 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.547164 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.547194 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.548574 (+ 1380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.549007 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.549011 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.549013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.549104 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.549430 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.549434 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.549435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.549664 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.549731 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.550109 (+ 378us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.550227 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:57:08.551785 31447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.534909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.1:59437)
0808 15:57:08.535178 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.535191 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.535434 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.535961 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.535968 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.536427 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.536879 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.536889 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.537968 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.537971 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.538994 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.539006 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.539768 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.539772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.540059 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.542108 (+ 2049us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.542136 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.544548 (+ 2412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.546986 (+ 2438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.546992 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.547007 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.547368 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.547994 (+ 626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.547998 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.548000 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.548276 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.548914 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.548922 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.549323 (+ 401us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.550559 (+ 1236us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.550835 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":256,"spinlock_wait_cycles":46848,"thread_start_us":82,"threads_started":1}
I20260808 15:57:08.551781 31445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.533895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:39673 (local address 127.19.93.1:55907)
0808 15:57:08.534873 (+ 978us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.534885 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.535435 (+ 550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.535961 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.535968 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.536427 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.536878 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.536889 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.537707 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.537710 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.539015 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.539022 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.539768 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.539772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.540057 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.542108 (+ 2051us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.542136 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.547006 (+ 4870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.548677 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.548680 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.548682 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.548905 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.549222 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.549225 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.549227 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.549322 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.549802 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.549804 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.549903 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.550617 (+ 714us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.550738 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":894,"mutex_wait_us":268,"spinlock_wait_cycles":27520,"thread_start_us":140,"threads_started":1}
I20260808 15:57:08.551781 31443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.533895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:42733 (local address 127.19.93.1:52431)
0808 15:57:08.534412 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.534462 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.535430 (+ 968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.535959 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.535966 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.536392 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.536868 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.536889 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.538206 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.538210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.539034 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.539045 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.539854 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.539858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.540064 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.542173 (+ 2109us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.542189 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.544573 (+ 2384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.547198 (+ 2625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.547202 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.547204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.547532 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.548734 (+ 1202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.548737 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.548739 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.548816 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.549275 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.549278 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.549362 (+ 84us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.550252 (+ 890us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.550698 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":116,"thread_start_us":538,"threads_started":1}
I20260808 15:57:08.553247 31439 heartbeater.cc:347] Connected to a master server at 127.19.93.61:39673
I20260808 15:57:08.553478 31439 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:08.554021 31439 heartbeater.cc:511] Master 127.19.93.61:39673 requested a full tablet report, sending...
I20260808 15:57:08.554678 31437 heartbeater.cc:347] Connected to a master server at 127.19.93.60:42733
I20260808 15:57:08.554765 31437 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:08.554919 31437 heartbeater.cc:511] Master 127.19.93.60:42733 requested a full tablet report, sending...
I20260808 15:57:08.555883 30823 ts_manager.cc:194] Registered new tserver with Master: 60052020656245e6a11a781e87d219d8 (127.19.93.1:36971)
I20260808 15:57:08.556039 31141 ts_manager.cc:194] Registered new tserver with Master: 60052020656245e6a11a781e87d219d8 (127.19.93.1:36971)
I20260808 15:57:08.556749 31434 heartbeater.cc:347] Connected to a master server at 127.19.93.62:34947
I20260808 15:57:08.556835 31434 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:08.556973 31434 heartbeater.cc:511] Master 127.19.93.62:34947 requested a full tablet report, sending...
I20260808 15:57:08.557739 29854 ts_manager.cc:194] Re-registered known tserver with Master: 60052020656245e6a11a781e87d219d8 (127.19.93.1:36971)
I20260808 15:57:08.558452 29854 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:59437
I20260808 15:57:08.564352 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:33589
--local_ip_for_outbound_sockets=127.19.93.2
--tserver_master_addrs=127.19.93.62:34947
--webserver_port=36355
--webserver_interface=127.19.93.2
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.2.keytab
--principal=oryx/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.93.62:34947,127.19.93.61:39673
--tserver_master_addrs=127.19.93.62:34947,127.19.93.61:39673,127.19.93.60:42733 with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:08.676818 31449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:08.677117 31449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:08.677188 31449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:08.681247 31449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:08.681310 31449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:08.681385 31449 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:57:08.686465 31449 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.2.keytab
--principal=oryx/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:33589
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=36355
--tserver_master_addrs=127.19.93.62:34947,127.19.93.61:39673,127.19.93.60:42733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:08.687428 31449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:08.688443 31449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:08.697731 31460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:08.697722 31464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:08.698045 31449 server_base.cc:1034] running on GCE node
W20260808 15:57:08.697723 31459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:08.698542 31449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:08.699119 31449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:08.700273 31449 hybrid_clock.cc:648] HybridClock initialized: now 1786204628700244 us; error 37 us; skew 500 ppm
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:08.702759 31449 init.cc:377] Logged in from keytab as oryx/127.19.93.2@KRBTEST.COM (short username oryx)
I20260808 15:57:08.703583 31449 webserver.cc:460] Webserver started at http://127.19.93.2:36355/ using document root <none> and password file <none>
I20260808 15:57:08.704129 31449 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:08.704223 31449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:08.707849 31449 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:57:08.709853 31479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:08.710989 31449 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260808 15:57:08.711093 31449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "2f2255aa9d2040c5a9e4a672000d4b63"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "709c3e59b4df28ab033b3cc87d00fd41"
server_key_iv: "9492ff1254910d5e02643af1d945fc3b"
server_key_version: "encryptionkey@0"
I20260808 15:57:08.711596 31449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:08.711891 30608 heartbeater.cc:503] Master 127.19.93.62:34947 was elected leader, sending a full tablet report...
I20260808 15:57:08.725244 31449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:08.727785 31449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:08.727926 31449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:08.728475 31449 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:08.729245 31449 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:08.729290 31449 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:08.729326 31449 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:08.729346 31449 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:08.737584 31449 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:33589
I20260808 15:57:08.737618 31667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:33589 every 8 connection(s)
I20260808 15:57:08.738487 31449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:57:08.742987 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 31449
I20260808 15:57:08.743145 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 30396
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.61@KRBTEST.COM
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.60@KRBTEST.COM
I20260808 15:57:08.757829 31041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.740198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:51075 (local address 127.19.93.61:39673)
0808 15:57:08.740333 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.740338 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.741862 (+ 1524us) server_negotiation.cc:407] Connection header received
0808 15:57:08.742376 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.742380 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.742435 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.742513 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.746572 (+ 4059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.747592 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.748829 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.749092 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.749153 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.751644 (+ 2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.751647 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.751650 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.751673 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.755174 (+ 3501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.756046 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.756050 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.756052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.756158 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.756611 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.756615 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.756616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.756850 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.756930 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.757559 (+ 629us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.757678 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:57:08.757862 31442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.740183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:36623 (local address 127.19.93.60:42733)
0808 15:57:08.740311 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.740316 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.741210 (+ 894us) server_negotiation.cc:407] Connection header received
0808 15:57:08.742257 (+ 1047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.742260 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.742323 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.742398 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.746522 (+ 4124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.747196 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.749078 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.749518 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.749628 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.752820 (+ 3192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.752824 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.752826 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.752856 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.754195 (+ 1339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.756023 (+ 1828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.756027 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.756029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.756146 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.756573 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.756577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.756579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.756807 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.756894 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.757568 (+ 674us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.757701 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM
I20260808 15:57:08.759420 31679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.740593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:39673 (local address 127.19.93.2:51075)
0808 15:57:08.741769 (+ 1176us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.741780 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.742061 (+ 281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.742588 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.742596 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.745794 (+ 3198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.746391 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.746405 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.747753 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.747757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.748706 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.748716 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.749316 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.749319 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.749489 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.750004 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.750022 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.751483 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.755293 (+ 3810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.755302 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.755318 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.755643 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.756263 (+ 620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.756266 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.756268 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.756476 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.756988 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.756990 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.757282 (+ 292us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.758025 (+ 743us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.758402 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1109,"mutex_wait_us":54,"spinlock_wait_cycles":16384,"thread_start_us":111,"threads_started":1}
I20260808 15:57:08.759666 31676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.740581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:42733 (local address 127.19.93.2:36623)
0808 15:57:08.741045 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.741095 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.742059 (+ 964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.742589 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.742597 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.743165 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.746374 (+ 3209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.746391 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.747514 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.747517 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.748919 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.748931 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.749814 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.749819 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.749933 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.750520 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.750550 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.752654 (+ 2104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.755714 (+ 3060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.755718 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.755720 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.755924 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.756254 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.756257 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.756259 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.756463 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.756969 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.756975 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.757283 (+ 308us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.758021 (+ 738us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.758481 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":208,"spinlock_wait_cycles":35584,"thread_start_us":120,"threads_started":1}
I20260808 15:57:08.760625 31671 heartbeater.cc:347] Connected to a master server at 127.19.93.61:39673
I20260808 15:57:08.760843 31671 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:08.761018 31670 heartbeater.cc:347] Connected to a master server at 127.19.93.60:42733
I20260808 15:57:08.761103 31670 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:08.761349 31671 heartbeater.cc:511] Master 127.19.93.61:39673 requested a full tablet report, sending...
I20260808 15:57:08.761349 31670 heartbeater.cc:511] Master 127.19.93.60:42733 requested a full tablet report, sending...
I20260808 15:57:08.762533 31141 ts_manager.cc:194] Registered new tserver with Master: 2f2255aa9d2040c5a9e4a672000d4b63 (127.19.93.2:33589)
I20260808 15:57:08.762744 30823 ts_manager.cc:194] Registered new tserver with Master: 2f2255aa9d2040c5a9e4a672000d4b63 (127.19.93.2:33589)
I20260808 15:57:08.763007 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.741531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:60189 (local address 127.19.93.62:34947)
0808 15:57:08.741642 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.741646 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.742062 (+ 416us) server_negotiation.cc:407] Connection header received
0808 15:57:08.742513 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.742517 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.742569 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.742645 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.754608 (+ 11963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.755124 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.755888 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.756210 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.756297 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.758861 (+ 2564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.758865 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.758867 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.758906 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.760932 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.761707 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.761711 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.761713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.761784 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.762068 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.762072 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.762074 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.762298 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.762408 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.762739 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.762863 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 15:57:08.763577 31678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.741433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.2:60189)
0808 15:57:08.741966 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.741980 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.742105 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.742676 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.742679 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.743165 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.754481 (+ 11316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.754488 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.755227 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.755230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.755774 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.755782 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.756437 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.756441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.756525 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.756980 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.756993 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.758698 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.761418 (+ 2720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.761421 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.761423 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.761618 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.761866 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.761869 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.761871 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.761965 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.762404 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.762407 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.762493 (+ 86us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.763320 (+ 827us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.763465 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":78,"threads_started":1}
I20260808 15:57:08.763604 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:43387
--local_ip_for_outbound_sockets=127.19.93.3
--tserver_master_addrs=127.19.93.62:34947
--webserver_port=38371
--webserver_interface=127.19.93.3
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.3.keytab
--principal=oryx/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.93.62:34947,127.19.93.61:39673
--tserver_master_addrs=127.19.93.62:34947,127.19.93.61:39673,127.19.93.60:42733 with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:57:08.764190 31669 heartbeater.cc:347] Connected to a master server at 127.19.93.62:34947
I20260808 15:57:08.764276 31669 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:08.764426 31669 heartbeater.cc:511] Master 127.19.93.62:34947 requested a full tablet report, sending...
I20260808 15:57:08.765072 29854 ts_manager.cc:194] Re-registered known tserver with Master: 2f2255aa9d2040c5a9e4a672000d4b63 (127.19.93.2:33589)
I20260808 15:57:08.765630 29854 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:60189
I20260808 15:57:08.788729 31442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.785692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45920 (local address 127.19.93.60:42733)
0808 15:57:08.785822 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.785826 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.785839 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:57:08.785887 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.785889 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.785936 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.786013 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:08.786231 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.786722 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.787731 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.788218 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.788325 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.788472 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.788545 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.788606 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:57:08.788729 30769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.785562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:42733 (local address 127.0.0.1:45920)
0808 15:57:08.785686 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.785698 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.785778 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.786034 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.786037 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.786055 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:08.786138 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.786143 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.786824 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.786827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.787587 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.787596 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.788339 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.788342 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.788439 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.788461 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.788535 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.788606 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 15:57:08.789332 31145 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 15:57:08.789707 31204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1726ee4c74d49c2b802b92782924566. Latest consensus state: current_term: 1 leader_uuid: "a1726ee4c74d49c2b802b92782924566" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } } }
I20260808 15:57:08.789850 31204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [sys.catalog]: This master's current role is: LEARNER
W20260808 15:57:08.873536 31684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:08.873747 31684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:08.873785 31684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:08.877812 31684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:08.877866 31684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:08.877920 31684 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:57:08.882963 31684 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.3.keytab
--principal=oryx/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:43387
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=38371
--tserver_master_addrs=127.19.93.62:34947,127.19.93.61:39673,127.19.93.60:42733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31684
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:08.883858 31684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:08.884797 31684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:08.894105 31698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:08.894258 31684 server_base.cc:1034] running on GCE node
W20260808 15:57:08.894122 31695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:08.894106 31701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:08.894943 31684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:08.895542 31684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:08.896688 31684 hybrid_clock.cc:648] HybridClock initialized: now 1786204628896670 us; error 27 us; skew 500 ppm
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:08.899277 31684 init.cc:377] Logged in from keytab as oryx/127.19.93.3@KRBTEST.COM (short username oryx)
I20260808 15:57:08.900111 31684 webserver.cc:460] Webserver started at http://127.19.93.3:38371/ using document root <none> and password file <none>
I20260808 15:57:08.900635 31684 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:08.900705 31684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:08.904626 31684 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:57:08.906495 31712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:08.907682 31684 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:08.907785 31684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "702abd1878ab40a087fd8116b59f6fbc"
format_stamp: "Formatted at 2026-08-08 15:57:07 on dist-test-slave-lgr5"
server_key: "1dbcc4c7ec5b57bb2ad9f48f30f88db4"
server_key_iv: "e011699022d633d98ce43ed4b4aebe50"
server_key_version: "encryptionkey@0"
I20260808 15:57:08.908360 31684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:08.930299 31684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:08.932992 31684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:08.933167 31684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:08.933733 31684 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:08.934576 31684 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:08.934624 31684 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:08.934679 31684 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:08.934706 31684 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:08.942934 31684 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:43387
I20260808 15:57:08.942976 31889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:43387 every 8 connection(s)
I20260808 15:57:08.943890 31684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:57:08.950248 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 31684
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.61@KRBTEST.COM
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM
Aug 08 15:57:08 dist-test-slave-lgr5 krb5kdc[29773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204628, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.60@KRBTEST.COM
I20260808 15:57:08.960460 31442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.945629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:45229 (local address 127.19.93.60:42733)
0808 15:57:08.945779 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.945784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.946621 (+ 837us) server_negotiation.cc:407] Connection header received
0808 15:57:08.947760 (+ 1139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.947763 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.947825 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.947903 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.949181 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.949960 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.951647 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.951956 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.952043 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.956214 (+ 4171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.956217 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.956220 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.956245 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.958717 (+ 2472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.959180 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.959183 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.959185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.959259 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.959571 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.959574 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.959576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.959769 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.959840 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.960185 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.960296 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 15:57:08.960857 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.947108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:56361 (local address 127.19.93.62:34947)
0808 15:57:08.947228 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.947231 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.947267 (+ 36us) server_negotiation.cc:407] Connection header received
0808 15:57:08.947867 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.947871 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.947923 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.947994 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.950104 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.950866 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.951885 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.952203 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.952271 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.956826 (+ 4555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.956829 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.956832 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.956858 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.959085 (+ 2227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.959553 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.959556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.959558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.959637 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.959934 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.959937 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.959939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.960158 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.960231 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.960606 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.960712 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:57:08.961285 31897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.945996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:42733 (local address 127.19.93.3:45229)
0808 15:57:08.946472 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.946524 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.947515 (+ 991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.948059 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.948068 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.948596 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.949030 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.949037 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.950109 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.950113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.951507 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.951519 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.952237 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.952241 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.952838 (+ 597us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.953830 (+ 992us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.953844 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.956003 (+ 2159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.958819 (+ 2816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.958822 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.958824 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.959082 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.959369 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.959372 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.959373 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.959470 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.959909 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.959911 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.959993 (+ 82us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.960776 (+ 783us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.961088 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":141,"spinlock_wait_cycles":26880,"thread_start_us":116,"threads_started":1}
I20260808 15:57:08.961354 31898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.946954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.3:56361)
0808 15:57:08.947200 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.947212 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.947517 (+ 305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.948059 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.948068 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.948596 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.949027 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.949036 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.951000 (+ 1964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.951004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.951774 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.951782 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.952433 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.952437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.952530 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.953416 (+ 886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.953430 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.956688 (+ 3258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.959200 (+ 2512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.959203 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.959205 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.959447 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.959740 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.959743 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.959744 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.959833 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.960308 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.960311 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.960418 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.961035 (+ 617us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.961166 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":61,"spinlock_wait_cycles":9472,"thread_start_us":79,"threads_started":1}
I20260808 15:57:08.961285 31896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.945995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:39673 (local address 127.19.93.3:33077)
0808 15:57:08.946472 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.946524 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.947513 (+ 989us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.948281 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.948284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.948556 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:08.949014 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.949027 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.950114 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.950117 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.951499 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.951509 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.952235 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.952240 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.952487 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.953178 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:08.953199 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:08.956003 (+ 2804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:08.958162 (+ 2159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.958168 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.958183 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.958515 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.958819 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:08.958822 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:08.958824 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:08.959035 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:08.959502 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:08.959508 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:08.959790 (+ 282us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.959999 (+ 209us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.960321 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":61,"spinlock_wait_cycles":28032,"thread_start_us":103,"threads_started":1}
I20260808 15:57:08.961644 31041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.945865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:33077 (local address 127.19.93.61:39673)
0808 15:57:08.946001 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.946006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.946620 (+ 614us) server_negotiation.cc:407] Connection header received
0808 15:57:08.948128 (+ 1508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.948131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.948180 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.948248 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.949150 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.949961 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.951632 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.951947 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.952015 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.956230 (+ 4215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.956234 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.956236 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.956259 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.958038 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.958632 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.958636 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.958638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.958724 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.959150 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.959153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.959155 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.959368 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.959452 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.961387 (+ 1935us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.961507 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 15:57:08.962738 31892 heartbeater.cc:347] Connected to a master server at 127.19.93.62:34947
I20260808 15:57:08.962877 31894 heartbeater.cc:347] Connected to a master server at 127.19.93.61:39673
I20260808 15:57:08.962984 31892 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:08.962983 31894 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:08.963572 31892 heartbeater.cc:511] Master 127.19.93.62:34947 requested a full tablet report, sending...
I20260808 15:57:08.963609 31893 heartbeater.cc:347] Connected to a master server at 127.19.93.60:42733
I20260808 15:57:08.963572 31894 heartbeater.cc:511] Master 127.19.93.61:39673 requested a full tablet report, sending...
I20260808 15:57:08.963712 31893 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:08.963865 31893 heartbeater.cc:511] Master 127.19.93.60:42733 requested a full tablet report, sending...
I20260808 15:57:08.964666 29854 ts_manager.cc:194] Re-registered known tserver with Master: 702abd1878ab40a087fd8116b59f6fbc (127.19.93.3:43387)
I20260808 15:57:08.964815 30823 ts_manager.cc:194] Registered new tserver with Master: 702abd1878ab40a087fd8116b59f6fbc (127.19.93.3:43387)
I20260808 15:57:08.965369 29854 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:56361
I20260808 15:57:08.966042 31141 ts_manager.cc:194] Registered new tserver with Master: 702abd1878ab40a087fd8116b59f6fbc (127.19.93.3:43387)
I20260808 15:57:08.966337 31915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.953125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44116 (local address 127.19.93.61:39673)
0808 15:57:08.953665 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.953669 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.954822 (+ 1153us) server_negotiation.cc:407] Connection header received
0808 15:57:08.955011 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.955015 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.955081 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.955142 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.955978 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.956726 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.957921 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.958265 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.958342 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.960966 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.960969 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.960972 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.960996 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.962731 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.965044 (+ 2313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.965048 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.965050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.965135 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.965422 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.965426 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.965428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.965619 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.965718 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.966076 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.966194 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":94,"threads_started":1}
I20260808 15:57:08.969705 31912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.952587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45936 (local address 127.19.93.60:42733)
0808 15:57:08.953523 (+ 936us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.953526 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.954451 (+ 925us) server_negotiation.cc:407] Connection header received
0808 15:57:08.954630 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.954634 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.954689 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.954781 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.956728 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.957462 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.963192 (+ 5730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.963478 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.963536 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.965954 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.965958 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.965960 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.965986 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.967827 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.968505 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.968509 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.968510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.968601 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.968892 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.968895 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.968897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.969104 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.969230 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.969442 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.969555 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":864,"thread_start_us":82,"threads_started":1}
I20260808 15:57:08.971050 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.952427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54160 (local address 127.19.93.62:34947)
0808 15:57:08.953792 (+ 1365us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.953796 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.954155 (+ 359us) server_negotiation.cc:407] Connection header received
0808 15:57:08.954281 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.954284 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.954330 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.954460 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:08.955653 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.956464 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.964759 (+ 8295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.966550 (+ 1791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.966642 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.968022 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:08.968026 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:08.968029 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:08.968053 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:08.969582 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.970001 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.970005 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.970006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.970101 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:08.970346 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:08.970349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:08.970351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:08.970589 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:08.970691 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.970847 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.970942 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1444,"server-negotiator.queue_time_us":1301,"thread_start_us":72,"threads_started":1}
I20260808 15:57:08.973547 29854 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54160:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:57:08.976634 29854 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:57:08.979055 31083 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a1726ee4c74d49c2b802b92782924566" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: NON_VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: true } } }
I20260808 15:57:08.979174 31083 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:08.982517 31922 raft_consensus.cc:1050] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566: attempting to promote NON_VOTER 277b1e52bfc24312a52d5342cf887252 to VOTER
I20260808 15:57:08.982838 31922 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } }
I20260808 15:57:08.983959 31145 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 1 LEARNER]: Refusing update from remote peer a1726ee4c74d49c2b802b92782924566: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 15:57:08.984407 31083 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [LEADER]: Connected to new peer: Peer: permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 15:57:08.984493 30838 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 FOLLOWER]: Refusing update from remote peer a1726ee4c74d49c2b802b92782924566: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 15:57:08.984859 31083 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 15:57:08.986377 31083 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 277b1e52bfc24312a52d5342cf887252 (127.19.93.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } } }
I20260808 15:57:08.987617 31083 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a1726ee4c74d49c2b802b92782924566" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } } }
I20260808 15:57:08.987743 31083 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:08.988171 30838 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 277b1e52bfc24312a52d5342cf887252 (127.19.93.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } } }
I20260808 15:57:08.987593 31933 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a1726ee4c74d49c2b802b92782924566" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } } }
I20260808 15:57:08.989795 31933 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:08.989992 31934 sys_catalog.cc:455] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a1726ee4c74d49c2b802b92782924566" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } } }
I20260808 15:57:08.990101 31934 sys_catalog.cc:458] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:57:08.995448 31145 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 277b1e52bfc24312a52d5342cf887252 (127.19.93.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } } }
I20260808 15:57:08.996232 31083 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a1726ee4c74d49c2b802b92782924566" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } } }
I20260808 15:57:08.996340 31083 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:08.997758 31204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a1726ee4c74d49c2b802b92782924566" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } } }
I20260808 15:57:08.997885 31204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:57:08.999135 30769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.993457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:43387 (local address 127.0.0.1:42598)
0808 15:57:08.993616 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.993629 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.993696 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.994746 (+ 1050us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.994749 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.994765 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:08.994867 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.994873 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.996488 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.996492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.997666 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.997675 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.998794 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.998798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:08.998889 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.998915 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 15:57:08.998956 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 15:57:08.999018 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 15:57:08.999837 31939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.993859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42598 (local address 127.19.93.3:43387)
0808 15:57:08.994268 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.994278 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.994301 (+ 23us) server_negotiation.cc:407] Connection header received
0808 15:57:08.994377 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.994383 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.994603 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.995012 (+ 409us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:08.995154 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.996319 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.997814 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.998655 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.999388 (+ 733us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:08.999557 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:08.999606 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 15:57:08.999698 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":100,"threads_started":1}
I20260808 15:57:09.003307 31937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.993477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:36971 (local address 127.0.0.1:44392)
0808 15:57:08.993700 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.993713 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.993796 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:08.997087 (+ 3291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:08.997090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:08.997110 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:08.997201 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:08.997208 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.999376 (+ 2168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:08.999380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:09.000513 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:09.000522 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.002903 (+ 2381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.002906 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:09.002989 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:09.003013 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:57:09.003081 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 15:57:09.003168 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":100,"threads_started":1}
I20260808 15:57:09.002810 31787 tablet_service.cc:1467] Processing CreateTablet for tablet 0d509b3e2d5a4643ad1fbf11f0ff6546 (DEFAULT_TABLE table=test-table [id=8e802bbef03d413592ea3045208ace88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:09.003396 31942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.994423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44392 (local address 127.19.93.1:36971)
0808 15:57:08.996613 (+ 2190us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.996624 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.996648 (+ 24us) server_negotiation.cc:407] Connection header received
0808 15:57:08.996722 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.996727 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.996928 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:08.997355 (+ 427us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:08.997535 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:08.999283 (+ 1748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.000729 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.001509 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.001616 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:09.001756 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:09.003138 (+ 1382us) server_negotiation.cc:299] Negotiation successful
0808 15:57:09.003246 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2084,"thread_start_us":94,"threads_started":1}
I20260808 15:57:09.004138 31938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.993783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:33589 (local address 127.0.0.1:55688)
0808 15:57:08.994024 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:08.994036 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:08.994115 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:09.000026 (+ 5911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:09.000029 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:09.000056 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:09.000155 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:09.000160 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.001628 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.001632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:09.002749 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:09.002761 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.003737 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.003741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:09.003828 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:09.003853 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 15:57:09.003913 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 15:57:09.003981 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":108,"threads_started":1}
I20260808 15:57:09.004060 31787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d509b3e2d5a4643ad1fbf11f0ff6546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:09.005821 31323 tablet_service.cc:1467] Processing CreateTablet for tablet 0d509b3e2d5a4643ad1fbf11f0ff6546 (DEFAULT_TABLE table=test-table [id=8e802bbef03d413592ea3045208ace88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:09.006767 31323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d509b3e2d5a4643ad1fbf11f0ff6546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:09.008428 31943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:08.994402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55688 (local address 127.19.93.2:33589)
0808 15:57:08.999582 (+ 5180us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:08.999596 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:08.999618 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:57:08.999689 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:08.999695 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:08.999875 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:09.000293 (+ 418us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:09.000428 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.001505 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.002871 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.003616 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.003781 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:09.003914 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:09.003961 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 15:57:09.004044 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5073,"thread_start_us":127,"threads_started":1}
I20260808 15:57:09.011133 31558 tablet_service.cc:1467] Processing CreateTablet for tablet 0d509b3e2d5a4643ad1fbf11f0ff6546 (DEFAULT_TABLE table=test-table [id=8e802bbef03d413592ea3045208ace88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:09.012212 31558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d509b3e2d5a4643ad1fbf11f0ff6546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:09.013219 31944 tablet_bootstrap.cc:492] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc: Bootstrap starting.
I20260808 15:57:09.013823 31945 tablet_bootstrap.cc:492] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8: Bootstrap starting.
I20260808 15:57:09.015569 31944 tablet_bootstrap.cc:654] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:09.015694 31945 tablet_bootstrap.cc:654] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:09.016494 31945 log.cc:824] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:09.016517 31944 log.cc:824] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:09.018093 31945 tablet_bootstrap.cc:492] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8: No bootstrap required, opened a new log
I20260808 15:57:09.018273 31945 ts_tablet_manager.cc:1397] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 15:57:09.018428 31944 tablet_bootstrap.cc:492] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc: No bootstrap required, opened a new log
I20260808 15:57:09.018617 31944 ts_tablet_manager.cc:1397] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:57:09.020121 31950 tablet_bootstrap.cc:492] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63: Bootstrap starting.
I20260808 15:57:09.022221 31950 tablet_bootstrap.cc:654] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:09.022301 31944 raft_consensus.cc:348] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } } peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } }
I20260808 15:57:09.022495 31944 raft_consensus.cc:374] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:09.022538 31944 raft_consensus.cc:729] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 702abd1878ab40a087fd8116b59f6fbc, State: Initialized, Role: FOLLOWER
I20260808 15:57:09.022650 31945 raft_consensus.cc:348] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } } peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } }
I20260808 15:57:09.022912 31945 raft_consensus.cc:374] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:09.022974 31945 raft_consensus.cc:729] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60052020656245e6a11a781e87d219d8, State: Initialized, Role: FOLLOWER
I20260808 15:57:09.022900 31944 consensus_queue.cc:260] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } } peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } }
I20260808 15:57:09.023219 31950 log.cc:824] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:09.023367 31945 consensus_queue.cc:260] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } } peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } }
I20260808 15:57:09.023831 31944 ts_tablet_manager.cc:1428] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 15:57:09.023962 31434 heartbeater.cc:503] Master 127.19.93.62:34947 was elected leader, sending a full tablet report...
I20260808 15:57:09.024276 31945 ts_tablet_manager.cc:1428] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8: Time spent starting tablet: real 0.006s user 0.002s sys 0.005s
I20260808 15:57:09.026032 31950 tablet_bootstrap.cc:492] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63: No bootstrap required, opened a new log
I20260808 15:57:09.026207 31950 ts_tablet_manager.cc:1397] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:57:09.029350 31892 heartbeater.cc:503] Master 127.19.93.62:34947 was elected leader, sending a full tablet report...
I20260808 15:57:09.030136 31950 raft_consensus.cc:348] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } } peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } }
I20260808 15:57:09.030373 31950 raft_consensus.cc:374] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:09.030437 31950 raft_consensus.cc:729] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f2255aa9d2040c5a9e4a672000d4b63, State: Initialized, Role: FOLLOWER
I20260808 15:57:09.030864 31950 consensus_queue.cc:260] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } } peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } }
I20260808 15:57:09.031450 31669 heartbeater.cc:503] Master 127.19.93.62:34947 was elected leader, sending a full tablet report...
I20260808 15:57:09.031766 31950 ts_tablet_manager.cc:1428] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260808 15:57:09.034093 31440 tablet.cc:2369] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:57:09.038074 31954 raft_consensus.cc:482] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:57:09.038213 31954 raft_consensus.cc:504] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } } peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } }
I20260808 15:57:09.039086 31954 leader_election.cc:288] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60052020656245e6a11a781e87d219d8 (127.19.93.1:36971), 2f2255aa9d2040c5a9e4a672000d4b63 (127.19.93.2:33589)
I20260808 15:57:09.042512 31942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:09.039317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:58467 (local address 127.19.93.1:36971)
0808 15:57:09.039423 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:09.039427 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:09.039469 (+ 42us) server_negotiation.cc:407] Connection header received
0808 15:57:09.039605 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:09.039608 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:09.039656 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:09.039729 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:09.039987 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.040540 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.041568 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.041956 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.042085 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:09.042146 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:09.042338 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 15:57:09.042406 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 15:57:09.042515 31898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:09.039279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:36971 (local address 127.19.93.3:58467)
0808 15:57:09.039414 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:09.039429 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:09.039516 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:09.039757 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:09.039760 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:09.039779 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:09.039890 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:09.039895 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.040650 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.040653 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:09.041452 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:09.041461 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.042086 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.042090 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:09.042192 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:09.042251 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 15:57:09.042314 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 15:57:09.042385 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":58}
I20260808 15:57:09.042613 31943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:09.039592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:60891 (local address 127.19.93.2:33589)
0808 15:57:09.039691 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:09.039696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:09.039735 (+ 39us) server_negotiation.cc:407] Connection header received
0808 15:57:09.039838 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:09.039841 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:09.039879 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:09.039937 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:09.040179 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.040678 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.041687 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.042086 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.042173 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:09.042229 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:09.042440 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 15:57:09.042504 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 15:57:09.042793 31897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:09.039539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:33589 (local address 127.19.93.3:60891)
0808 15:57:09.039688 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:09.039699 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:09.039768 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:09.039954 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:09.039957 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:09.039970 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:09.040071 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:09.040098 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.040775 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.040778 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:09.041575 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:09.041584 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.042198 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.042201 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:09.042334 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:09.042351 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 15:57:09.042416 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 15:57:09.042480 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":33}
I20260808 15:57:09.043057 31355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d509b3e2d5a4643ad1fbf11f0ff6546" candidate_uuid: "702abd1878ab40a087fd8116b59f6fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60052020656245e6a11a781e87d219d8" is_pre_election: true
I20260808 15:57:09.043278 31598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d509b3e2d5a4643ad1fbf11f0ff6546" candidate_uuid: "702abd1878ab40a087fd8116b59f6fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" is_pre_election: true
I20260808 15:57:09.043322 31355 raft_consensus.cc:2454] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 702abd1878ab40a087fd8116b59f6fbc in term 0.
I20260808 15:57:09.043533 31598 raft_consensus.cc:2454] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 702abd1878ab40a087fd8116b59f6fbc in term 0.
I20260808 15:57:09.043746 31715 leader_election.cc:302] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60052020656245e6a11a781e87d219d8, 702abd1878ab40a087fd8116b59f6fbc; no voters:
I20260808 15:57:09.043989 31954 raft_consensus.cc:2781] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:57:09.044131 31954 raft_consensus.cc:482] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:57:09.044201 31954 raft_consensus.cc:3037] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:09.045393 31954 raft_consensus.cc:504] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } } peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } }
I20260808 15:57:09.045722 31954 leader_election.cc:288] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [CANDIDATE]: Term 1 election: Requested vote from peers 60052020656245e6a11a781e87d219d8 (127.19.93.1:36971), 2f2255aa9d2040c5a9e4a672000d4b63 (127.19.93.2:33589)
I20260808 15:57:09.046041 31355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d509b3e2d5a4643ad1fbf11f0ff6546" candidate_uuid: "702abd1878ab40a087fd8116b59f6fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60052020656245e6a11a781e87d219d8"
I20260808 15:57:09.046069 31598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d509b3e2d5a4643ad1fbf11f0ff6546" candidate_uuid: "702abd1878ab40a087fd8116b59f6fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f2255aa9d2040c5a9e4a672000d4b63"
I20260808 15:57:09.046159 31598 raft_consensus.cc:3037] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:09.046159 31355 raft_consensus.cc:3037] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:09.047341 31598 raft_consensus.cc:2454] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 702abd1878ab40a087fd8116b59f6fbc in term 1.
I20260808 15:57:09.047341 31355 raft_consensus.cc:2454] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 702abd1878ab40a087fd8116b59f6fbc in term 1.
I20260808 15:57:09.047603 31715 leader_election.cc:302] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60052020656245e6a11a781e87d219d8, 702abd1878ab40a087fd8116b59f6fbc; no voters:
I20260808 15:57:09.047751 31954 raft_consensus.cc:2781] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:09.047945 31954 raft_consensus.cc:686] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [term 1 LEADER]: Becoming Leader. State: Replica: 702abd1878ab40a087fd8116b59f6fbc, State: Running, Role: LEADER
I20260808 15:57:09.048266 31954 consensus_queue.cc:237] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } } peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } }
I20260808 15:57:09.051215 29853 catalog_manager.cc:5495] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc reported cstate change: term changed from 0 to 1, leader changed from <none> to 702abd1878ab40a087fd8116b59f6fbc (127.19.93.3). New cstate: current_term: 1 leader_uuid: "702abd1878ab40a087fd8116b59f6fbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } health_report { overall_health: HEALTHY } } }
I20260808 15:57:09.073630 31939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:09.070364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42612 (local address 127.19.93.3:43387)
0808 15:57:09.070484 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:09.070488 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:09.070501 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:57:09.070568 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:09.070570 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:09.070625 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:09.070716 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:57:09.070972 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.071476 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.072356 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.072589 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.072677 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:09.072894 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:57:09.073297 (+ 403us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:57:09.073387 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:09.073435 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 15:57:09.073487 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 15:57:09.079485 31355 raft_consensus.cc:1261] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8 [term 1 FOLLOWER]: Refusing update from remote peer 702abd1878ab40a087fd8116b59f6fbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:09.079489 31598 raft_consensus.cc:1261] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 1 FOLLOWER]: Refusing update from remote peer 702abd1878ab40a087fd8116b59f6fbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:09.080188 31954 consensus_queue.cc:1035] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:09.080377 31958 consensus_queue.cc:1035] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:09.088919 31964 mvcc.cc:205] Tried to move back new op lower bound from 7316294160702373888 to 7316294160584077312. Current Snapshot: MvccSnapshot[applied={T|T < 7316294160702373888}]
I20260808 15:57:09.093519 31966 mvcc.cc:205] Tried to move back new op lower bound from 7316294160702373888 to 7316294160584077312. Current Snapshot: MvccSnapshot[applied={T|T < 7316294160702373888 or (T in {7316294160702373888})}]
I20260808 15:57:09.099650 29853 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54160:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:09.099822 29853 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54160:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:09.104432 29853 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a1726ee4c74d49c2b802b92782924566: Sending DeleteTablet for 3 replicas of tablet 0d509b3e2d5a4643ad1fbf11f0ff6546
I20260808 15:57:09.105137 31323 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d509b3e2d5a4643ad1fbf11f0ff6546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:09 UTC) from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:44392
I20260808 15:57:09.105144 31787 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d509b3e2d5a4643ad1fbf11f0ff6546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:09 UTC) from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:42598
I20260808 15:57:09.105185 31558 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d509b3e2d5a4643ad1fbf11f0ff6546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:09 UTC) from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:55688
I20260808 15:57:09.105563 31321 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d509b3e2d5a4643ad1fbf11f0ff6546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:09 UTC) from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:44392
I20260808 15:57:09.105628 31982 tablet_replica.cc:330] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc: stopping tablet replica
I20260808 15:57:09.105933 31982 raft_consensus.cc:2229] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:57:09.106256 31982 raft_consensus.cc:2258] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:09.106590 31981 tablet_replica.cc:330] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8: stopping tablet replica
I20260808 15:57:09.106865 31981 raft_consensus.cc:2229] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:09.107141 31981 raft_consensus.cc:2258] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:09.109247 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 29795
I20260808 15:57:09.109236 31981 ts_tablet_manager.cc:1905] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:09.111490 31981 ts_tablet_manager.cc:1918] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:09.111567 31981 log.cc:1196] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-0/wal/wals/0d509b3e2d5a4643ad1fbf11f0ff6546
I20260808 15:57:09.111801 31981 ts_tablet_manager.cc:1939] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 60052020656245e6a11a781e87d219d8: Deleting consensus metadata
I20260808 15:57:09.112332 31979 tablet_replica.cc:330] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63: stopping tablet replica
I20260808 15:57:09.112568 31979 raft_consensus.cc:2229] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:09.112787 31979 raft_consensus.cc:2258] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:09.118021 31979 ts_tablet_manager.cc:1905] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:09.118206 31982 ts_tablet_manager.cc:1905] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:09.120707 31979 ts_tablet_manager.cc:1918] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:09.120812 31979 log.cc:1196] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/0d509b3e2d5a4643ad1fbf11f0ff6546
I20260808 15:57:09.121107 31979 ts_tablet_manager.cc:1939] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 2f2255aa9d2040c5a9e4a672000d4b63: Deleting consensus metadata
I20260808 15:57:09.124521 31982 ts_tablet_manager.cc:1918] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:09.124662 31982 log.cc:1196] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/0d509b3e2d5a4643ad1fbf11f0ff6546
I20260808 15:57:09.125029 31982 ts_tablet_manager.cc:1939] T 0d509b3e2d5a4643ad1fbf11f0ff6546 P 702abd1878ab40a087fd8116b59f6fbc: Deleting consensus metadata
W20260808 15:57:09.125658 31486 connection.cc:535] server connection from 127.0.0.1:55688 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 15:57:09.126103 31245 connection.cc:535] server connection from 127.0.0.1:44392 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 15:57:09.126449 31715 connection.cc:535] server connection from 127.0.0.1:42598 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 15:57:09.130386 31915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:09.106850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44122 (local address 127.19.93.61:39673)
0808 15:57:09.106968 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:09.106973 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:09.120390 (+ 13417us) server_negotiation.cc:407] Connection header received
0808 15:57:09.120516 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:09.120519 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:09.120568 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:09.120636 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:09.121774 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.122590 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.123887 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.124254 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.124364 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:09.126927 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:09.126932 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:09.126934 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:09.126961 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:09.128650 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:09.129104 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:09.129108 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:09.129110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:09.129192 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:09.129498 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:09.129501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:09.129503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:09.129728 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:09.129863 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:09.130092 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 15:57:09.130226 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:57:09.137622 31912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:09.107418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45938 (local address 127.19.93.60:42733)
0808 15:57:09.107705 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:09.107709 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:09.130524 (+ 22815us) server_negotiation.cc:407] Connection header received
0808 15:57:09.130575 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:09.130578 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:09.130627 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:09.130694 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:09.131389 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.131991 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.132774 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.133041 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.133134 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:09.134537 (+ 1403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:09.134541 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:09.134543 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:09.134570 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:09.136016 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:09.136427 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:09.136430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:09.136432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:09.136511 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:09.136815 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:09.136818 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:09.136820 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:09.137009 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:09.137131 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:09.137348 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 15:57:09.137470 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213}
I20260808 15:57:09.138293 31041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:09.129788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44124 (local address 127.19.93.61:39673)
0808 15:57:09.129890 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:09.129894 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:09.129906 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:57:09.129939 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:09.129941 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:09.129980 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:09.130051 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:09.131105 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.131869 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.133014 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.133312 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.133405 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:09.134563 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:09.134567 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:09.134569 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:09.134594 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:09.136294 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:09.136683 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:09.136686 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:09.136688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:09.136765 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:09.137001 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:09.137004 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:09.137006 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:09.137199 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:09.137314 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:09.138045 (+ 731us) server_negotiation.cc:299] Negotiation successful
0808 15:57:09.138155 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 15:57:09.145664 31912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:09.138259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45940 (local address 127.19.93.60:42733)
0808 15:57:09.138560 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:09.138564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:09.138577 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:57:09.138614 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:09.138617 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:09.138655 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:09.138725 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:09.139581 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.140358 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.141134 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:09.141470 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:09.141565 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:09.142739 (+ 1174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:09.142743 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:09.142746 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:09.142770 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:09.144271 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:09.144630 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:09.144633 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:09.144634 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:09.144711 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:09.144947 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:09.144950 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:09.144952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:09.145139 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:09.145254 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:09.145422 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 15:57:09.145520 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 15:57:10.095046 31995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.094635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.2:42015)
0808 15:57:10.094867 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.094954 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":70,"threads_started":1}
W20260808 15:57:10.095358 31669 heartbeater.cc:644] Failed to heartbeat to 127.19.93.62:34947 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
I20260808 15:57:10.101856 31996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.101433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.3:35965)
0808 15:57:10.101660 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.101753 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":74,"threads_started":1}
W20260808 15:57:10.102521 31892 heartbeater.cc:644] Failed to heartbeat to 127.19.93.62:34947 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
I20260808 15:57:10.105995 31997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.105627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.1:47585)
0808 15:57:10.105848 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.105919 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":73,"threads_started":1}
W20260808 15:57:10.106256 31434 heartbeater.cc:644] Failed to heartbeat to 127.19.93.62:34947 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
I20260808 15:57:10.604323 31998 raft_consensus.cc:482] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1726ee4c74d49c2b802b92782924566)
I20260808 15:57:10.604453 31998 raft_consensus.cc:504] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } }
I20260808 15:57:10.604868 31998 leader_election.cc:288] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1726ee4c74d49c2b802b92782924566 (127.19.93.62:34947), a49beb7aa14d4812b1bbf79cfa2843c3 (127.19.93.61:39673)
I20260808 15:57:10.605441 31999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.605015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.0.0.1:60444)
0808 15:57:10.605232 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.605333 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":65,"threads_started":1}
W20260808 15:57:10.605654 31113 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
I20260808 15:57:10.606550 32001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.606327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.0.0.1:60456)
0808 15:57:10.606447 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.606496 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 15:57:10.606673 31113 leader_election.cc:334] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a1726ee4c74d49c2b802b92782924566 (127.19.93.62:34947): Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
I20260808 15:57:10.608764 31999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.605331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:39673 (local address 127.0.0.1:34288)
0808 15:57:10.605587 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.605601 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:10.605699 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:10.605973 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:10.605976 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:10.606001 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:10.606108 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:10.606115 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.606995 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.606998 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:10.607794 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:10.607804 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.608460 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.608463 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:10.608534 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:10.608556 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 15:57:10.608616 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 15:57:10.608675 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":98,"threads_started":1}
I20260808 15:57:10.608824 32002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.605423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34288 (local address 127.19.93.61:39673)
0808 15:57:10.605730 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:10.605734 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:10.605772 (+ 38us) server_negotiation.cc:407] Connection header received
0808 15:57:10.605828 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:10.605831 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:10.605872 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:10.605937 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:10.606221 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.606887 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.607883 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.608371 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.608452 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:10.608505 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:10.608633 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 15:57:10.608688 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":97,"threads_started":1}
I20260808 15:57:10.608989 32005 raft_consensus.cc:482] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1726ee4c74d49c2b802b92782924566)
I20260808 15:57:10.609094 32005 raft_consensus.cc:504] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } }
I20260808 15:57:10.609139 30838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "277b1e52bfc24312a52d5342cf887252" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" is_pre_election: true
I20260808 15:57:10.609273 30838 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 277b1e52bfc24312a52d5342cf887252 in term 1.
I20260808 15:57:10.609534 32005 leader_election.cc:288] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1726ee4c74d49c2b802b92782924566 (127.19.93.62:34947), 277b1e52bfc24312a52d5342cf887252 (127.19.93.60:42733)
I20260808 15:57:10.609570 31113 leader_election.cc:302] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 277b1e52bfc24312a52d5342cf887252, a49beb7aa14d4812b1bbf79cfa2843c3; no voters: a1726ee4c74d49c2b802b92782924566
I20260808 15:57:10.609792 31998 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 15:57:10.609843 31998 raft_consensus.cc:482] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1726ee4c74d49c2b802b92782924566)
I20260808 15:57:10.609880 31998 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 1 FOLLOWER]: Advancing to term 2
I20260808 15:57:10.610046 32006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.609608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.0.0.1:60458)
0808 15:57:10.609909 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.609971 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":61,"threads_started":1}
W20260808 15:57:10.610206 30805 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
I20260808 15:57:10.610934 32006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.610748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.0.0.1:60470)
0808 15:57:10.610840 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.610886 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 15:57:10.611033 30805 leader_election.cc:334] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a1726ee4c74d49c2b802b92782924566 (127.19.93.62:34947): Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
I20260808 15:57:10.611213 31998 raft_consensus.cc:504] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } }
I20260808 15:57:10.611500 31998 leader_election.cc:288] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [CANDIDATE]: Term 2 election: Requested vote from peers a1726ee4c74d49c2b802b92782924566 (127.19.93.62:34947), a49beb7aa14d4812b1bbf79cfa2843c3 (127.19.93.61:39673)
I20260808 15:57:10.611974 30838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "277b1e52bfc24312a52d5342cf887252" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3"
I20260808 15:57:10.612056 31999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.611627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.0.0.1:60482)
0808 15:57:10.611930 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.611981 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238}
I20260808 15:57:10.612071 30838 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 1 FOLLOWER]: Advancing to term 2
I20260808 15:57:10.613070 30838 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 277b1e52bfc24312a52d5342cf887252 in term 2.
I20260808 15:57:10.613444 31113 leader_election.cc:302] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 277b1e52bfc24312a52d5342cf887252, a49beb7aa14d4812b1bbf79cfa2843c3; no voters:
I20260808 15:57:10.613811 31998 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 15:57:10.613881 31999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.613698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.0.0.1:60484)
0808 15:57:10.613785 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.613829 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 15:57:10.614020 31998 raft_consensus.cc:686] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [term 2 LEADER]: Becoming Leader. State: Replica: 277b1e52bfc24312a52d5342cf887252, State: Running, Role: LEADER
I20260808 15:57:10.614090 32007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.609694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:42733 (local address 127.0.0.1:38456)
0808 15:57:10.610078 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.610092 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:10.610588 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:10.610914 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:10.610917 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:10.610937 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:10.611017 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:10.611023 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.611867 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.611870 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:10.612812 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:10.612823 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.613712 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.613715 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:10.613805 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:10.613829 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:57:10.613902 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 15:57:10.613971 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":55,"threads_started":1}
I20260808 15:57:10.614302 31998 consensus_queue.cc:237] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } }
I20260808 15:57:10.614445 32009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.609814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38456 (local address 127.19.93.60:42733)
0808 15:57:10.610083 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:10.610092 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:10.610562 (+ 470us) server_negotiation.cc:407] Connection header received
0808 15:57:10.610694 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:10.610697 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:10.610736 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:10.610804 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:10.611134 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.611737 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.612934 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.613497 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.613595 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:10.613652 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:10.614222 (+ 570us) server_negotiation.cc:299] Negotiation successful
0808 15:57:10.614294 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":117,"threads_started":1}
I20260808 15:57:10.615461 31145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "277b1e52bfc24312a52d5342cf887252" is_pre_election: true
I20260808 15:57:10.615725 32012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 277b1e52bfc24312a52d5342cf887252. Latest consensus state: current_term: 2 leader_uuid: "277b1e52bfc24312a52d5342cf887252" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } } }
W20260808 15:57:10.615769 31113 leader_election.cc:334] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a1726ee4c74d49c2b802b92782924566 (127.19.93.62:34947): Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
I20260808 15:57:10.615847 32012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:10.615900 30806 leader_election.cc:302] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a49beb7aa14d4812b1bbf79cfa2843c3; no voters: 277b1e52bfc24312a52d5342cf887252, a1726ee4c74d49c2b802b92782924566
I20260808 15:57:10.616137 32005 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 15:57:10.616164 32014 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:57:10.618427 32014 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:57:10.618809 32014 catalog_manager.cc:1259] Loaded cluster ID: 223a69c248b14254b20b10633e252df1
I20260808 15:57:10.618854 32014 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:57:10.619365 32014 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:57:10.619736 32014 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: Loaded TSK: 0
I20260808 15:57:10.620399 32014 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:57:10.645032 31141 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45940:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:57:10.647962 31141 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:57:10.650646 31999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.650435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.0.0.1:60504)
0808 15:57:10.650524 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.650575 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 15:57:10.650916 30838 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [term 2 FOLLOWER]: Refusing update from remote peer 277b1e52bfc24312a52d5342cf887252: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 15:57:10.651309 31999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.651112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.0.0.1:60508)
0808 15:57:10.651210 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.651256 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 15:57:10.651378 31998 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260808 15:57:10.651531 31113 consensus_peers.cc:487] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 -> Peer a1726ee4c74d49c2b802b92782924566 (127.19.93.62:34947): Couldn't send request to peer a1726ee4c74d49c2b802b92782924566. Status: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 15:57:10.652768 32005 sys_catalog.cc:455] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 277b1e52bfc24312a52d5342cf887252. Latest consensus state: current_term: 2 leader_uuid: "277b1e52bfc24312a52d5342cf887252" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } } }
I20260808 15:57:10.652882 32005 sys_catalog.cc:458] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:57:10.653837 32012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "277b1e52bfc24312a52d5342cf887252" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } } }
I20260808 15:57:10.653946 32012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:10.654304 32005 sys_catalog.cc:455] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "277b1e52bfc24312a52d5342cf887252" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a1726ee4c74d49c2b802b92782924566" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34947 } } peers { permanent_uuid: "a49beb7aa14d4812b1bbf79cfa2843c3" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 39673 } attrs { promote: false } } peers { permanent_uuid: "277b1e52bfc24312a52d5342cf887252" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 42733 } attrs { promote: false } } }
I20260808 15:57:10.654408 32005 sys_catalog.cc:458] T 00000000000000000000000000000000 P a49beb7aa14d4812b1bbf79cfa2843c3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:57:10.654560 32017 mvcc.cc:205] Tried to move back new op lower bound from 7316294167141212160 to 7316294166998556672. Current Snapshot: MvccSnapshot[applied={T|T < 7316294167141212160}]
I20260808 15:57:10.663210 31999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.659056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:43387 (local address 127.0.0.1:47236)
0808 15:57:10.659166 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.659180 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:10.659259 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:10.659903 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:10.659906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:10.659925 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:10.660016 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:10.660022 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.661120 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.661123 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:10.662032 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:10.662042 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.662855 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.662858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:10.662958 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:10.662984 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 15:57:10.663031 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 15:57:10.663098 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":54}
I20260808 15:57:10.663441 32001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.659306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:36971 (local address 127.0.0.1:35582)
0808 15:57:10.659438 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.659449 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:10.659526 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:10.660139 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:10.660142 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:10.660161 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:10.660255 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:10.660261 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.661183 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.661186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:10.662257 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:10.662266 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.663100 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.663103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:10.663191 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:10.663215 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:57:10.663261 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 15:57:10.663326 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"mutex_wait_us":36}
I20260808 15:57:10.663755 32023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.659418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47236 (local address 127.19.93.3:43387)
0808 15:57:10.659652 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:10.659657 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:10.659672 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:57:10.659724 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:10.659727 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:10.659782 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:10.660337 (+ 555us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:10.660468 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.661022 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.662152 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.662734 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.663477 (+ 743us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:10.663546 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:10.663582 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 15:57:10.663649 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":74,"threads_started":1}
I20260808 15:57:10.663983 32024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.659441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35582 (local address 127.19.93.1:36971)
0808 15:57:10.659910 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:10.659914 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:10.659926 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:57:10.659971 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:10.659974 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:10.660016 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:10.660133 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:10.660382 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.661090 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.662378 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.662982 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.663705 (+ 723us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:10.663773 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:10.663807 (+ 34us) server_negotiation.cc:299] Negotiation successful
0808 15:57:10.663877 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":73,"threads_started":1}
I20260808 15:57:10.664281 31787 tablet_service.cc:1467] Processing CreateTablet for tablet 4802e2ea03d14715ac9f637895de8120 (DEFAULT_TABLE table=test-table [id=c41675f34ed140dc864db9c92c758a52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:10.664481 32028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.659844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40620 (local address 127.19.93.2:33589)
0808 15:57:10.660111 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:10.660116 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:10.660312 (+ 196us) server_negotiation.cc:407] Connection header received
0808 15:57:10.660482 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:10.660485 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:10.660531 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:10.660599 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:10.660948 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.661695 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.663071 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.663680 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.663778 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:10.663834 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:10.664286 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 15:57:10.664363 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":86,"threads_started":1}
I20260808 15:57:10.664482 31321 tablet_service.cc:1467] Processing CreateTablet for tablet 4802e2ea03d14715ac9f637895de8120 (DEFAULT_TABLE table=test-table [id=c41675f34ed140dc864db9c92c758a52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:10.664580 31787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4802e2ea03d14715ac9f637895de8120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:10.664505 32025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.659722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:33589 (local address 127.0.0.1:40620)
0808 15:57:10.660232 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.660244 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:10.660374 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:10.660732 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:10.660735 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:10.660751 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:10.660830 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:10.660835 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.661809 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.661813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:10.662902 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:10.662913 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.663915 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.663922 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:10.664007 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:10.664169 (+ 162us) client_negotiation.cc:769] Sending connection context
0808 15:57:10.664250 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 15:57:10.664323 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"mutex_wait_us":47,"thread_start_us":88,"threads_started":1}
I20260808 15:57:10.664760 31321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4802e2ea03d14715ac9f637895de8120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:10.665230 31558 tablet_service.cc:1467] Processing CreateTablet for tablet 4802e2ea03d14715ac9f637895de8120 (DEFAULT_TABLE table=test-table [id=c41675f34ed140dc864db9c92c758a52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:10.665484 31558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4802e2ea03d14715ac9f637895de8120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:10.666786 32029 tablet_bootstrap.cc:492] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc: Bootstrap starting.
I20260808 15:57:10.667271 32030 tablet_bootstrap.cc:492] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8: Bootstrap starting.
I20260808 15:57:10.667795 32029 tablet_bootstrap.cc:654] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:10.667922 32031 tablet_bootstrap.cc:492] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63: Bootstrap starting.
I20260808 15:57:10.668176 32030 tablet_bootstrap.cc:654] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:10.668807 32031 tablet_bootstrap.cc:654] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:10.669220 32030 tablet_bootstrap.cc:492] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8: No bootstrap required, opened a new log
I20260808 15:57:10.669307 32030 ts_tablet_manager.cc:1397] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 15:57:10.669703 32030 raft_consensus.cc:348] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } } peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } }
I20260808 15:57:10.669795 32030 raft_consensus.cc:374] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:10.669826 32030 raft_consensus.cc:729] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60052020656245e6a11a781e87d219d8, State: Initialized, Role: FOLLOWER
I20260808 15:57:10.669914 32031 tablet_bootstrap.cc:492] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63: No bootstrap required, opened a new log
I20260808 15:57:10.669914 32029 tablet_bootstrap.cc:492] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc: No bootstrap required, opened a new log
I20260808 15:57:10.670001 32029 ts_tablet_manager.cc:1397] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 15:57:10.670001 32031 ts_tablet_manager.cc:1397] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 15:57:10.669957 32030 consensus_queue.cc:260] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } } peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } }
I20260808 15:57:10.670266 32030 ts_tablet_manager.cc:1428] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 15:57:10.670374 32029 raft_consensus.cc:348] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } } peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } }
I20260808 15:57:10.670374 32031 raft_consensus.cc:348] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } } peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } }
I20260808 15:57:10.670480 32029 raft_consensus.cc:374] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:10.670480 32031 raft_consensus.cc:374] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:10.670513 32031 raft_consensus.cc:729] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f2255aa9d2040c5a9e4a672000d4b63, State: Initialized, Role: FOLLOWER
I20260808 15:57:10.670513 32029 raft_consensus.cc:729] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 702abd1878ab40a087fd8116b59f6fbc, State: Initialized, Role: FOLLOWER
I20260808 15:57:10.670627 32029 consensus_queue.cc:260] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } } peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } }
I20260808 15:57:10.670627 32031 consensus_queue.cc:260] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } } peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } }
I20260808 15:57:10.670928 32031 ts_tablet_manager.cc:1428] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:57:10.670928 32029 ts_tablet_manager.cc:1428] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:57:10.671176 32041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.670516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.1:58935)
0808 15:57:10.671020 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.671081 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":85,"threads_started":1}
I20260808 15:57:10.671977 32041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.671601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.1:35803)
0808 15:57:10.671851 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.671911 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":86,"threads_started":1}
I20260808 15:57:10.672660 32049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.672296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.2:41299)
0808 15:57:10.672517 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.672578 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":79,"threads_started":1}
I20260808 15:57:10.673696 31437 heartbeater.cc:503] Master 127.19.93.60:42733 was elected leader, sending a full tablet report...
I20260808 15:57:10.674245 32048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.671678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.3:48949)
0808 15:57:10.673945 (+ 2267us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.674168 (+ 223us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2205,"thread_start_us":93,"threads_started":1}
I20260808 15:57:10.675006 31670 heartbeater.cc:503] Master 127.19.93.60:42733 was elected leader, sending a full tablet report...
I20260808 15:57:10.675257 32049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.674746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.2:40593)
0808 15:57:10.675143 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.675194 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271}
I20260808 15:57:10.675385 32048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.675105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.3:36149)
0808 15:57:10.675284 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.675330 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260808 15:57:10.675674 31893 heartbeater.cc:503] Master 127.19.93.60:42733 was elected leader, sending a full tablet report...
W20260808 15:57:10.696621 31895 tablet.cc:2369] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:57:10.710937 32040 raft_consensus.cc:482] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:57:10.711032 32040 raft_consensus.cc:504] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } } peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } }
I20260808 15:57:10.712119 32040 leader_election.cc:288] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 702abd1878ab40a087fd8116b59f6fbc (127.19.93.3:43387), 2f2255aa9d2040c5a9e4a672000d4b63 (127.19.93.2:33589)
I20260808 15:57:10.715641 32047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.712294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:43387 (local address 127.19.93.1:55727)
0808 15:57:10.712413 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.712426 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:10.712526 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:10.712777 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:10.712780 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:10.712796 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:10.712983 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:10.712992 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.713674 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.713677 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:10.714622 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:10.714632 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.715237 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.715241 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:10.715334 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:10.715358 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:57:10.715428 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 15:57:10.715496 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":73}
I20260808 15:57:10.715651 32023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.712350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:55727 (local address 127.19.93.3:43387)
0808 15:57:10.712461 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:10.712465 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:10.712481 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:57:10.712634 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:10.712637 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:10.712687 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:10.712750 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:10.713086 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.713574 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.714731 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.715126 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.715206 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:10.715267 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:10.715459 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 15:57:10.715525 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:57:10.715684 32028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.712385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:36231 (local address 127.19.93.2:33589)
0808 15:57:10.712484 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:10.712489 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:10.712633 (+ 144us) server_negotiation.cc:407] Connection header received
0808 15:57:10.712736 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:10.712739 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:10.712788 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:10.712856 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:10.713101 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.713581 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.714743 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.715151 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.715246 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:10.715304 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:10.715503 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 15:57:10.715572 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 15:57:10.715675 32041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.712306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:33589 (local address 127.19.93.1:36231)
0808 15:57:10.712549 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.712560 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:10.712652 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:10.712876 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:10.712879 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:10.712896 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:10.713001 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:10.713006 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.713680 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.713683 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:10.714630 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:10.714640 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.715264 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.715268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:10.715392 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:10.715417 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 15:57:10.715485 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 15:57:10.715552 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":164}
I20260808 15:57:10.716193 31822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4802e2ea03d14715ac9f637895de8120" candidate_uuid: "60052020656245e6a11a781e87d219d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "702abd1878ab40a087fd8116b59f6fbc" is_pre_election: true
I20260808 15:57:10.716223 31598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4802e2ea03d14715ac9f637895de8120" candidate_uuid: "60052020656245e6a11a781e87d219d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" is_pre_election: true
I20260808 15:57:10.716351 31598 raft_consensus.cc:2454] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60052020656245e6a11a781e87d219d8 in term 0.
I20260808 15:57:10.716414 31822 raft_consensus.cc:2454] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60052020656245e6a11a781e87d219d8 in term 0.
I20260808 15:57:10.716714 31246 leader_election.cc:302] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f2255aa9d2040c5a9e4a672000d4b63, 60052020656245e6a11a781e87d219d8; no voters:
I20260808 15:57:10.716964 32040 raft_consensus.cc:2781] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:57:10.717022 32040 raft_consensus.cc:482] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:57:10.717068 32040 raft_consensus.cc:3037] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:10.718029 32040 raft_consensus.cc:504] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } } peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } }
I20260808 15:57:10.718326 32040 leader_election.cc:288] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [CANDIDATE]: Term 1 election: Requested vote from peers 702abd1878ab40a087fd8116b59f6fbc (127.19.93.3:43387), 2f2255aa9d2040c5a9e4a672000d4b63 (127.19.93.2:33589)
I20260808 15:57:10.718628 31822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4802e2ea03d14715ac9f637895de8120" candidate_uuid: "60052020656245e6a11a781e87d219d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "702abd1878ab40a087fd8116b59f6fbc"
I20260808 15:57:10.718648 31598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4802e2ea03d14715ac9f637895de8120" candidate_uuid: "60052020656245e6a11a781e87d219d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f2255aa9d2040c5a9e4a672000d4b63"
I20260808 15:57:10.718743 31598 raft_consensus.cc:3037] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:10.718757 31822 raft_consensus.cc:3037] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:10.719584 31598 raft_consensus.cc:2454] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60052020656245e6a11a781e87d219d8 in term 1.
I20260808 15:57:10.719679 31822 raft_consensus.cc:2454] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60052020656245e6a11a781e87d219d8 in term 1.
I20260808 15:57:10.719832 31246 leader_election.cc:302] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f2255aa9d2040c5a9e4a672000d4b63, 60052020656245e6a11a781e87d219d8; no voters:
I20260808 15:57:10.719983 32040 raft_consensus.cc:2781] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:10.720217 32040 raft_consensus.cc:686] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [term 1 LEADER]: Becoming Leader. State: Replica: 60052020656245e6a11a781e87d219d8, State: Running, Role: LEADER
I20260808 15:57:10.720453 32040 consensus_queue.cc:237] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } } peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } }
I20260808 15:57:10.720779 32041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.720602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.1:35389)
0808 15:57:10.720683 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.720729 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 15:57:10.722627 31140 catalog_manager.cc:5495] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60052020656245e6a11a781e87d219d8 (127.19.93.1). New cstate: current_term: 1 leader_uuid: "60052020656245e6a11a781e87d219d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60052020656245e6a11a781e87d219d8" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 } health_report { overall_health: UNKNOWN } } }
W20260808 15:57:10.741045 31672 tablet.cc:2369] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:57:10.744550 32024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.740770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35586 (local address 127.19.93.1:36971)
0808 15:57:10.740911 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:10.740916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:10.740930 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:57:10.741044 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:10.741048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:10.741109 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:10.741200 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:57:10.741520 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.741993 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.743125 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:10.743344 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:10.743420 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:10.743691 (+ 271us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:57:10.744196 (+ 505us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:57:10.744289 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:10.744362 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 15:57:10.744413 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 15:57:10.746902 31598 raft_consensus.cc:1261] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 1 FOLLOWER]: Refusing update from remote peer 60052020656245e6a11a781e87d219d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:10.747165 31822 raft_consensus.cc:1261] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc [term 1 FOLLOWER]: Refusing update from remote peer 60052020656245e6a11a781e87d219d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:10.747380 32053 consensus_queue.cc:1035] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f2255aa9d2040c5a9e4a672000d4b63" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:10.747707 32040 consensus_queue.cc:1035] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "702abd1878ab40a087fd8116b59f6fbc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 43387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:10.749588 32048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.749193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.3:33507)
0808 15:57:10.749461 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.749521 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192}
I20260808 15:57:10.751308 32049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.750256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.2:41569)
0808 15:57:10.751184 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.751241 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":855}
I20260808 15:57:10.753443 32041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.753206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.1:40683)
0808 15:57:10.753324 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.753377 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 15:57:10.754065 32049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.752859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.2:47893)
0808 15:57:10.753948 (+ 1089us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.754004 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":943}
I20260808 15:57:10.754245 32048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.754031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:34947 (local address 127.19.93.3:45599)
0808 15:57:10.754134 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.754185 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:34947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 15:57:10.760569 31141 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45940:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:10.760728 31141 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45940:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:10.764194 31141 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 277b1e52bfc24312a52d5342cf887252: Sending DeleteTablet for 3 replicas of tablet 4802e2ea03d14715ac9f637895de8120
I20260808 15:57:10.764739 31787 tablet_service.cc:1514] Processing DeleteTablet for tablet 4802e2ea03d14715ac9f637895de8120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:10 UTC) from {username='oryx', principal='oryx/127.19.93.60@KRBTEST.COM'} at 127.0.0.1:47236
I20260808 15:57:10.765053 31321 tablet_service.cc:1514] Processing DeleteTablet for tablet 4802e2ea03d14715ac9f637895de8120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:10 UTC) from {username='oryx', principal='oryx/127.19.93.60@KRBTEST.COM'} at 127.0.0.1:35582
I20260808 15:57:10.765354 31558 tablet_service.cc:1514] Processing DeleteTablet for tablet 4802e2ea03d14715ac9f637895de8120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:10 UTC) from {username='oryx', principal='oryx/127.19.93.60@KRBTEST.COM'} at 127.0.0.1:40620
I20260808 15:57:10.765407 32072 tablet_replica.cc:330] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8: stopping tablet replica
I20260808 15:57:10.765548 32072 raft_consensus.cc:2229] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:57:10.765687 32073 tablet_replica.cc:330] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63: stopping tablet replica
I20260808 15:57:10.765833 32072 raft_consensus.cc:2258] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:10.766333 32071 tablet_replica.cc:330] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc: stopping tablet replica
I20260808 15:57:10.766458 32071 raft_consensus.cc:2229] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:10.766484 32072 ts_tablet_manager.cc:1905] T 4802e2ea03d14715ac9f637895de8120 P 60052020656245e6a11a781e87d219d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:10.766556 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 31077
I20260808 15:57:10.766572 32071 raft_consensus.cc:2258] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:10.770028 32071 ts_tablet_manager.cc:1905] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:10.772217 32071 ts_tablet_manager.cc:1918] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:10.772270 32071 log.cc:1196] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/4802e2ea03d14715ac9f637895de8120
I20260808 15:57:10.772411 32073 raft_consensus.cc:2229] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:10.772533 32071 ts_tablet_manager.cc:1939] T 4802e2ea03d14715ac9f637895de8120 P 702abd1878ab40a087fd8116b59f6fbc: Deleting consensus metadata
I20260808 15:57:10.772548 32073 raft_consensus.cc:2258] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:10.773115 31115 catalog_manager.cc:4841] TS 702abd1878ab40a087fd8116b59f6fbc (127.19.93.3:43387): tablet 4802e2ea03d14715ac9f637895de8120 (table test-table [id=c41675f34ed140dc864db9c92c758a52]) successfully deleted
I20260808 15:57:10.773137 32073 ts_tablet_manager.cc:1905] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:10.775503 32073 ts_tablet_manager.cc:1918] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:10.775594 32073 log.cc:1196] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/4802e2ea03d14715ac9f637895de8120
I20260808 15:57:10.775838 32073 ts_tablet_manager.cc:1939] T 4802e2ea03d14715ac9f637895de8120 P 2f2255aa9d2040c5a9e4a672000d4b63: Deleting consensus metadata
I20260808 15:57:10.776455 31114 catalog_manager.cc:4841] TS 2f2255aa9d2040c5a9e4a672000d4b63 (127.19.93.2:33589): tablet 4802e2ea03d14715ac9f637895de8120 (table test-table [id=c41675f34ed140dc864db9c92c758a52]) successfully deleted
I20260808 15:57:10.777099 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 31449
I20260808 15:57:10.777146 32025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:10.776931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:36971 (local address 127.0.0.1:35598)
0808 15:57:10.777036 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:10.777083 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:36971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 15:57:10.783569 31114 catalog_manager.cc:4584] TS 60052020656245e6a11a781e87d219d8 (127.19.93.1:36971): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4802e2ea03d14715ac9f637895de8120: Network error: Client connection negotiation failed: client connection to 127.19.93.1:36971: connect: Connection refused (error 111)
I20260808 15:57:10.789496 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 31684
I20260808 15:57:10.802075 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 30619
I20260808 15:57:10.815372 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 30795
2026-08-08T15:57:10Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5260 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:57:10 dist-test-slave-lgr5 krb5kdc[32077](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:57:10 dist-test-slave-lgr5 krb5kdc[32077](info): set up 2 sockets
Aug 08 15:57:10 dist-test-slave-lgr5 krb5kdc[32077](info): commencing operation
krb5kdc: starting...
W20260808 15:57:11.966845 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:57:12 dist-test-slave-lgr5 krb5kdc[32077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:57:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:57:12Z Disabled control of system clock
WARNING: no policy specified for oryx/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.62.keytab.
Entry for principal oryx/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.62.keytab.
I20260808 15:57:12.083894 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:36459
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.62.keytab
--principal=oryx/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:36459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:12.190122 32100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:12.190356 32100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:12.190418 32100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:12.194268 32100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:57:12.194314 32100 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 15:57:12.194337 32100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:12.194360 32100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:12.194393 32100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:57:12.194422 32100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:57:12.199479 32100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:36459
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.62.keytab
--principal=oryx/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:36459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:12.200415 32100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:12.201323 32100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:12.209216 32108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:12.209391 32100 server_base.cc:1034] running on GCE node
W20260808 15:57:12.209237 32115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:12.209313 32109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:12.210103 32100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:12.211082 32100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:12.212234 32100 hybrid_clock.cc:648] HybridClock initialized: now 1786204632212213 us; error 31 us; skew 500 ppm
Aug 08 15:57:12 dist-test-slave-lgr5 krb5kdc[32077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204632, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:12.214744 32100 init.cc:377] Logged in from keytab as oryx/127.19.93.62@KRBTEST.COM (short username oryx)
I20260808 15:57:12.215533 32100 webserver.cc:460] Webserver started at http://127.19.93.62:39809/ using document root <none> and password file <none>
I20260808 15:57:12.216020 32100 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:12.216094 32100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:12.216279 32100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:12.218116 32100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "70354424f7f14c51a4b2b8781a0cf55e"
format_stamp: "Formatted at 2026-08-08 15:57:12 on dist-test-slave-lgr5"
server_key: "16ac587e15803decc59e41b8aa114b0b"
server_key_iv: "cf93231be226738ae7e51bab2f6f55d8"
server_key_version: "encryptionkey@0"
I20260808 15:57:12.218616 32100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "70354424f7f14c51a4b2b8781a0cf55e"
format_stamp: "Formatted at 2026-08-08 15:57:12 on dist-test-slave-lgr5"
server_key: "16ac587e15803decc59e41b8aa114b0b"
server_key_iv: "cf93231be226738ae7e51bab2f6f55d8"
server_key_version: "encryptionkey@0"
I20260808 15:57:12.222075 32100 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:57:12.224344 32122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:12.225411 32100 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 15:57:12.225513 32100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "70354424f7f14c51a4b2b8781a0cf55e"
format_stamp: "Formatted at 2026-08-08 15:57:12 on dist-test-slave-lgr5"
server_key: "16ac587e15803decc59e41b8aa114b0b"
server_key_iv: "cf93231be226738ae7e51bab2f6f55d8"
server_key_version: "encryptionkey@0"
I20260808 15:57:12.225610 32100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:12.238767 32100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:12.241209 32100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:12.241370 32100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:12.248522 32100 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:36459
I20260808 15:57:12.248550 32218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:36459 every 8 connection(s)
I20260808 15:57:12.249344 32100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:57:12.251863 32220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:12.257107 32220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e: Bootstrap starting.
I20260808 15:57:12.259197 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 32100
I20260808 15:57:12.259335 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:57:12.259534 32220 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:12.259660 19828 external_mini_cluster.cc:1428] Setting key 3c8672543faa17c6efb46b92803b6121
I20260808 15:57:12.260391 32220 log.cc:824] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:12.262550 32220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e: No bootstrap required, opened a new log
I20260808 15:57:12.266614 32220 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70354424f7f14c51a4b2b8781a0cf55e" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36459 } }
I20260808 15:57:12.266876 32220 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:12.266947 32220 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70354424f7f14c51a4b2b8781a0cf55e, State: Initialized, Role: FOLLOWER
I20260808 15:57:12.267364 32220 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70354424f7f14c51a4b2b8781a0cf55e" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36459 } }
I20260808 15:57:12.267482 32220 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:57:12.267539 32220 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:57:12.267632 32220 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [term 0 FOLLOWER]: Advancing to term 1
Aug 08 15:57:12 dist-test-slave-lgr5 krb5kdc[32077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM
I20260808 15:57:12.268451 32220 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70354424f7f14c51a4b2b8781a0cf55e" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36459 } }
I20260808 15:57:12.268739 32220 leader_election.cc:302] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70354424f7f14c51a4b2b8781a0cf55e; no voters:
I20260808 15:57:12.269016 32220 leader_election.cc:288] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:57:12.269110 32229 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:12.269315 32229 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [term 1 LEADER]: Becoming Leader. State: Replica: 70354424f7f14c51a4b2b8781a0cf55e, State: Running, Role: LEADER
I20260808 15:57:12.269598 32229 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70354424f7f14c51a4b2b8781a0cf55e" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36459 } }
I20260808 15:57:12.270291 32220 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:57:12.270689 32229 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70354424f7f14c51a4b2b8781a0cf55e. Latest consensus state: current_term: 1 leader_uuid: "70354424f7f14c51a4b2b8781a0cf55e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70354424f7f14c51a4b2b8781a0cf55e" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36459 } } }
I20260808 15:57:12.270807 32229 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:12.271200 32234 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:57:12.271201 32230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70354424f7f14c51a4b2b8781a0cf55e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70354424f7f14c51a4b2b8781a0cf55e" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36459 } } }
I20260808 15:57:12.271436 32230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:12.274303 32234 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:57:12.275146 32228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:12.260786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35112 (local address 127.19.93.62:36459)
0808 15:57:12.261195 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:12.261217 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:12.261258 (+ 41us) server_negotiation.cc:407] Connection header received
0808 15:57:12.262062 (+ 804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:12.262084 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:12.262464 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:12.262816 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:12.263435 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.264970 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.265761 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.266462 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.266628 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:12.269026 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:12.269032 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:12.269047 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:12.269078 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:12.271143 (+ 2065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:12.271684 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:12.271689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:12.271695 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:12.271840 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:12.272214 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:12.272217 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:12.272219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:12.272753 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:12.273617 (+ 864us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:12.273761 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 15:57:12.274034 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":129,"threads_started":1}
I20260808 15:57:12.279520 32234 catalog_manager.cc:1347] Generated new cluster ID: f9fd7899644747c08706dc6f8e504e0e
I20260808 15:57:12.279570 32234 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:57:12.291044 32234 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:57:12.291852 32234 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:57:12.297986 32234 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e: Generated new TSK 0
I20260808 15:57:12.298555 32234 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.1.keytab.
Entry for principal oryx/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.1.keytab.
I20260808 15:57:12.331394 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36459
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.1.keytab
--principal=oryx/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:12.463579 32259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:12.463804 32259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:12.463847 32259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:12.467734 32259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:12.467793 32259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:12.467839 32259 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:57:12.467890 32259 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:57:12.472996 32259 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.1.keytab
--principal=oryx/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.93.62:36459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:12.473909 32259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:12.474854 32259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:12.483798 32268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:12.483855 32265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:12.483839 32266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:12.484102 32259 server_base.cc:1034] running on GCE node
I20260808 15:57:12.484452 32259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:12.484999 32259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:12.486150 32259 hybrid_clock.cc:648] HybridClock initialized: now 1786204632486133 us; error 31 us; skew 500 ppm
Aug 08 15:57:12 dist-test-slave-lgr5 krb5kdc[32077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204632, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:12.488788 32259 init.cc:377] Logged in from keytab as oryx/127.19.93.1@KRBTEST.COM (short username oryx)
I20260808 15:57:12.489655 32259 webserver.cc:460] Webserver started at http://127.19.93.1:43781/ using document root <none> and password file <none>
I20260808 15:57:12.490289 32259 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:12.490366 32259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:12.490587 32259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:12.492676 32259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "eef9750d84e74b9b8fded942e7d7c81c"
format_stamp: "Formatted at 2026-08-08 15:57:12 on dist-test-slave-lgr5"
server_key: "fb48d738bd73ed8d46e8b681ee92b86c"
server_key_iv: "33b1b8ed36dab18819a229b1b97e7cbe"
server_key_version: "encryptionkey@0"
I20260808 15:57:12.493345 32259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "eef9750d84e74b9b8fded942e7d7c81c"
format_stamp: "Formatted at 2026-08-08 15:57:12 on dist-test-slave-lgr5"
server_key: "fb48d738bd73ed8d46e8b681ee92b86c"
server_key_iv: "33b1b8ed36dab18819a229b1b97e7cbe"
server_key_version: "encryptionkey@0"
I20260808 15:57:12.496933 32259 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:57:12.499256 32278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:12.500468 32259 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:57:12.500572 32259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "eef9750d84e74b9b8fded942e7d7c81c"
format_stamp: "Formatted at 2026-08-08 15:57:12 on dist-test-slave-lgr5"
server_key: "fb48d738bd73ed8d46e8b681ee92b86c"
server_key_iv: "33b1b8ed36dab18819a229b1b97e7cbe"
server_key_version: "encryptionkey@0"
I20260808 15:57:12.500654 32259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:12.523051 32259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:12.525708 32259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:12.525847 32259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:12.527143 32259 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:12.527187 32259 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:12.527225 32259 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:12.527244 32259 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:57:12 dist-test-slave-lgr5 krb5kdc[32077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204632, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM
I20260808 15:57:12.537302 32259 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:33705
I20260808 15:57:12.537405 32461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:33705 every 8 connection(s)
I20260808 15:57:12.538166 32259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:57:12.540181 32228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:12.527872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:56665 (local address 127.19.93.62:36459)
0808 15:57:12.528018 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:12.528023 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:12.528836 (+ 813us) server_negotiation.cc:407] Connection header received
0808 15:57:12.530138 (+ 1302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:12.530141 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:12.530202 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:12.530260 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:12.531850 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.532574 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.533812 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.534056 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.534147 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:12.536788 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:12.536791 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:12.536793 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:12.536818 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:12.538210 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:12.538742 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:12.538745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:12.538747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:12.538837 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:12.539140 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:12.539143 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:12.539145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:12.539320 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:12.539413 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:12.539862 (+ 449us) server_negotiation.cc:299] Negotiation successful
0808 15:57:12.539994 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 15:57:12.540865 32295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:12.528262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36459 (local address 127.19.93.1:56665)
0808 15:57:12.528696 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:12.528743 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:12.529855 (+ 1112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:12.530676 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:12.530685 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:12.531073 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:12.531709 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:12.531731 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.532690 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.532693 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:12.533692 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:12.533703 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.534211 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.534215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:12.534390 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:12.534872 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:12.534890 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:12.536610 (+ 1720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:12.538319 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:12.538324 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:12.538337 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:12.538626 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:12.538916 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:12.538919 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:12.538922 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:12.539049 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:12.539421 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:12.539427 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:12.539646 (+ 219us) client_negotiation.cc:769] Sending connection context
0808 15:57:12.539801 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 15:57:12.540122 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":112,"threads_started":1}
I20260808 15:57:12.541973 32462 heartbeater.cc:347] Connected to a master server at 127.19.93.62:36459
I20260808 15:57:12.542109 32462 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:12.542546 32462 heartbeater.cc:511] Master 127.19.93.62:36459 requested a full tablet report, sending...
I20260808 15:57:12.544114 32146 ts_manager.cc:194] Registered new tserver with Master: eef9750d84e74b9b8fded942e7d7c81c (127.19.93.1:33705)
I20260808 15:57:12.545432 32146 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:56665
I20260808 15:57:12.547909 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 32259
I20260808 15:57:12.548028 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:57:12.548380 19828 external_mini_cluster.cc:1428] Setting key d162fd129759c7a76cc29cabc4b89246
I20260808 15:57:12.550452 32471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:12.543904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36459 (local address 127.19.93.1:35327)
0808 15:57:12.544206 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:12.544221 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:12.544319 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:12.544526 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:12.544528 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:12.544724 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:12.544836 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:12.544843 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.545558 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.545561 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:12.546269 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:12.546279 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.546705 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.546709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:12.546798 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:12.547197 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:12.547207 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:12.547486 (+ 279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:12.549127 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:12.549130 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:12.549132 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:12.549308 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:12.549554 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:12.549557 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:12.549559 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:12.549637 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:12.549969 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:12.549972 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:12.550063 (+ 91us) client_negotiation.cc:769] Sending connection context
0808 15:57:12.550147 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 15:57:12.550269 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":94,"threads_started":1}
I20260808 15:57:12.550454 32228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:12.544000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:35327 (local address 127.19.93.62:36459)
0808 15:57:12.544180 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:12.544183 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:12.544291 (+ 108us) server_negotiation.cc:407] Connection header received
0808 15:57:12.544395 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:12.544397 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:12.544434 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:12.544493 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:12.544927 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.545437 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.546378 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.546606 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.546692 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:12.547615 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:12.547618 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:12.547621 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:12.547644 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:12.549026 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:12.549393 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:12.549397 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:12.549398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:12.549474 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:12.549716 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:12.549719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:12.549721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:12.549880 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:12.549962 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:12.550214 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 15:57:12.550315 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":116}
WARNING: no policy specified for oryx/127.19.93.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.93.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.2.keytab.
Entry for principal oryx/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.2.keytab.
I20260808 15:57:12.573298 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36459
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.2.keytab
--principal=oryx/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:12.679867 32475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:12.680125 32475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:12.680197 32475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:12.684154 32475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:12.684201 32475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:12.684237 32475 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:57:12.684273 32475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:57:12.689213 32475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.2.keytab
--principal=oryx/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.93.62:36459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32475
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:12.690136 32475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:12.691022 32475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:12.699836 32495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:12.699878 32498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:12.699878 32493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:12.700069 32475 server_base.cc:1034] running on GCE node
I20260808 15:57:12.700533 32475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:12.701107 32475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:12.702253 32475 hybrid_clock.cc:648] HybridClock initialized: now 1786204632702223 us; error 42 us; skew 500 ppm
Aug 08 15:57:12 dist-test-slave-lgr5 krb5kdc[32077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204632, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:12.704931 32475 init.cc:377] Logged in from keytab as oryx/127.19.93.2@KRBTEST.COM (short username oryx)
I20260808 15:57:12.705724 32475 webserver.cc:460] Webserver started at http://127.19.93.2:32899/ using document root <none> and password file <none>
I20260808 15:57:12.706207 32475 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:12.706262 32475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:12.706432 32475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:12.708352 32475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c"
format_stamp: "Formatted at 2026-08-08 15:57:12 on dist-test-slave-lgr5"
server_key: "df17f5c7fa608a36ff4db1dcdd4b4fc2"
server_key_iv: "ac5172f2ae0081c11ae03c11a9463c15"
server_key_version: "encryptionkey@0"
I20260808 15:57:12.708838 32475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c"
format_stamp: "Formatted at 2026-08-08 15:57:12 on dist-test-slave-lgr5"
server_key: "df17f5c7fa608a36ff4db1dcdd4b4fc2"
server_key_iv: "ac5172f2ae0081c11ae03c11a9463c15"
server_key_version: "encryptionkey@0"
I20260808 15:57:12.712139 32475 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:57:12.714324 32515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:12.715453 32475 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 15:57:12.715547 32475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c"
format_stamp: "Formatted at 2026-08-08 15:57:12 on dist-test-slave-lgr5"
server_key: "df17f5c7fa608a36ff4db1dcdd4b4fc2"
server_key_iv: "ac5172f2ae0081c11ae03c11a9463c15"
server_key_version: "encryptionkey@0"
I20260808 15:57:12.715624 32475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:12.734068 32475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:12.736901 32475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:12.737037 32475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:12.738329 32475 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:12.738386 32475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:12.738436 32475 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:12.738464 32475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:57:12 dist-test-slave-lgr5 krb5kdc[32077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204632, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM
I20260808 15:57:12.748323 32475 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:35071
I20260808 15:57:12.748466 32729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:35071 every 8 connection(s)
I20260808 15:57:12.749150 32475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:57:12.751616 32228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:12.739036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:42351 (local address 127.19.93.62:36459)
0808 15:57:12.739177 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:12.739182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:12.739971 (+ 789us) server_negotiation.cc:407] Connection header received
0808 15:57:12.740963 (+ 992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:12.740966 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:12.741023 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:12.741089 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:12.742670 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.743522 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.745252 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.745606 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.745698 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:12.748438 (+ 2740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:12.748442 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:12.748445 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:12.748474 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:12.749969 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:12.750455 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:12.750458 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:12.750460 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:12.750539 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:12.750781 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:12.750783 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:12.750785 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:12.750947 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:12.751015 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:12.751406 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 15:57:12.751499 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:57:12.752377 32532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:12.739378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36459 (local address 127.19.93.2:42351)
0808 15:57:12.739807 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:12.739855 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:12.740717 (+ 862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:12.741467 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:12.741474 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:12.741869 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:12.742514 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:12.742534 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.743690 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.743694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:12.745110 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:12.745124 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.745768 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.745773 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:12.745977 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:12.746530 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:12.746551 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:12.748244 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:12.750078 (+ 1834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:12.750083 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:12.750093 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:12.750358 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:12.750603 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:12.750605 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:12.750606 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:12.750718 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:12.751014 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:12.751019 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:12.751225 (+ 206us) client_negotiation.cc:769] Sending connection context
0808 15:57:12.751360 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 15:57:12.751577 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":115,"threads_started":1}
I20260808 15:57:12.753433 32732 heartbeater.cc:347] Connected to a master server at 127.19.93.62:36459
I20260808 15:57:12.753561 32732 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:12.754000 32732 heartbeater.cc:511] Master 127.19.93.62:36459 requested a full tablet report, sending...
I20260808 15:57:12.754994 32148 ts_manager.cc:194] Registered new tserver with Master: ad1162ddbe6f480e8d7c5cc5efe5d26c (127.19.93.2:35071)
I20260808 15:57:12.755759 32148 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:42351
I20260808 15:57:12.758674 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 32475
I20260808 15:57:12.758807 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:57:12.759145 19828 external_mini_cluster.cc:1428] Setting key f53ddfedd04aa01cd5679bf6f76165e8
I20260808 15:57:12.761857 32739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:12.755273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36459 (local address 127.19.93.2:44663)
0808 15:57:12.755568 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:12.755580 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:12.755665 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:12.755878 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:12.755880 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:12.756069 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:12.756212 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:12.756220 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.757162 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.757165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:12.757698 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:12.757705 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.758079 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.758082 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:12.758140 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:12.758523 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:12.758537 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:12.758918 (+ 381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:12.760536 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:12.760547 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:12.760549 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:12.760721 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:12.760985 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:12.760987 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:12.760988 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:12.761053 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:12.761476 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:12.761478 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:12.761560 (+ 82us) client_negotiation.cc:769] Sending connection context
0808 15:57:12.761636 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 15:57:12.761729 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":91,"threads_started":1}
I20260808 15:57:12.762064 32228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:12.755332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:44663 (local address 127.19.93.62:36459)
0808 15:57:12.755428 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:12.755431 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:12.755637 (+ 206us) server_negotiation.cc:407] Connection header received
0808 15:57:12.755737 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:12.755739 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:12.755771 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:12.755837 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:12.756321 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.757050 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.757796 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.757997 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.758079 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:12.759031 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:12.759034 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:12.759036 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:12.759067 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:12.760442 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:12.760808 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:12.760812 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:12.760814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:12.760912 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:12.761119 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:12.761122 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:12.761124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:12.761392 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:12.761484 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:12.761702 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 15:57:12.761802 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
WARNING: no policy specified for oryx/127.19.93.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.93.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.3.keytab.
Entry for principal oryx/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.3.keytab.
I20260808 15:57:12.784811 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36459
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.3.keytab
--principal=oryx/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:12.892253 32743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:12.892488 32743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:12.892529 32743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:12.896368 32743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:12.896418 32743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:12.896454 32743 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:57:12.896499 32743 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:57:12.901448 32743 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.3.keytab
--principal=oryx/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.93.62:36459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:12.902339 32743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:12.903258 32743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:12.912142 32754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:12.912132 32755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:12.912249 32743 server_base.cc:1034] running on GCE node
W20260808 15:57:12.912420 32757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:12.912798 32743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:12.913364 32743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:12.914517 32743 hybrid_clock.cc:648] HybridClock initialized: now 1786204632914502 us; error 27 us; skew 500 ppm
Aug 08 15:57:12 dist-test-slave-lgr5 krb5kdc[32077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204632, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:12.917142 32743 init.cc:377] Logged in from keytab as oryx/127.19.93.3@KRBTEST.COM (short username oryx)
I20260808 15:57:12.917906 32743 webserver.cc:460] Webserver started at http://127.19.93.3:37647/ using document root <none> and password file <none>
I20260808 15:57:12.918398 32743 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:12.918457 32743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:12.918684 32743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:12.920670 32743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "a0b862dff21c4a96858014a1afd77d85"
format_stamp: "Formatted at 2026-08-08 15:57:12 on dist-test-slave-lgr5"
server_key: "a4a7c40d4f77caa50dbed449d87efd8e"
server_key_iv: "a88c2a12cb15f2e4e1396b93cc33d25a"
server_key_version: "encryptionkey@0"
I20260808 15:57:12.921195 32743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "a0b862dff21c4a96858014a1afd77d85"
format_stamp: "Formatted at 2026-08-08 15:57:12 on dist-test-slave-lgr5"
server_key: "a4a7c40d4f77caa50dbed449d87efd8e"
server_key_iv: "a88c2a12cb15f2e4e1396b93cc33d25a"
server_key_version: "encryptionkey@0"
I20260808 15:57:12.924515 32743 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:57:12.926664 303 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:12.927743 32743 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:12.927838 32743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "a0b862dff21c4a96858014a1afd77d85"
format_stamp: "Formatted at 2026-08-08 15:57:12 on dist-test-slave-lgr5"
server_key: "a4a7c40d4f77caa50dbed449d87efd8e"
server_key_iv: "a88c2a12cb15f2e4e1396b93cc33d25a"
server_key_version: "encryptionkey@0"
I20260808 15:57:12.927928 32743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:12.937289 32743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:12.940064 32743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:12.940272 32743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:12.941622 32743 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:12.941668 32743 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:12.941705 32743 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:12.941730 32743 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:57:12 dist-test-slave-lgr5 krb5kdc[32077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204632, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM
I20260808 15:57:12.951474 32743 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:38959
I20260808 15:57:12.951545 498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:38959 every 8 connection(s)
I20260808 15:57:12.952492 32743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:57:12.954593 32228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:12.942216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:34367 (local address 127.19.93.62:36459)
0808 15:57:12.942357 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:12.942362 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:12.943177 (+ 815us) server_negotiation.cc:407] Connection header received
0808 15:57:12.944217 (+ 1040us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:12.944221 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:12.944280 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:12.944374 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:12.945860 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.946681 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.948339 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.948689 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.948797 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:12.951115 (+ 2318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:12.951119 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:12.951122 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:12.951150 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:12.952704 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:12.953273 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:12.953276 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:12.953277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:12.953353 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:12.953728 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:12.953731 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:12.953732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:12.953914 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:12.953992 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:12.954378 (+ 386us) server_negotiation.cc:299] Negotiation successful
0808 15:57:12.954475 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:57:12.955339 320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:12.942590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36459 (local address 127.19.93.3:34367)
0808 15:57:12.943024 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:12.943070 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:12.943967 (+ 897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:12.944590 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:12.944600 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:12.945038 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:12.945683 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:12.945705 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.946817 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.946821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:12.948205 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:12.948218 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.948831 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.948836 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:12.949009 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:12.949519 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:12.949535 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:12.950958 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:12.952813 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:12.952819 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:12.952833 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:12.953152 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:12.953440 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:12.953443 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:12.953445 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:12.953628 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:12.953990 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:12.953995 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:12.954200 (+ 205us) client_negotiation.cc:769] Sending connection context
0808 15:57:12.954342 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 15:57:12.954578 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":105,"threads_started":1}
I20260808 15:57:12.956486 499 heartbeater.cc:347] Connected to a master server at 127.19.93.62:36459
I20260808 15:57:12.956629 499 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:12.957162 499 heartbeater.cc:511] Master 127.19.93.62:36459 requested a full tablet report, sending...
I20260808 15:57:12.958240 32146 ts_manager.cc:194] Registered new tserver with Master: a0b862dff21c4a96858014a1afd77d85 (127.19.93.3:38959)
I20260808 15:57:12.958921 32146 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:34367
I20260808 15:57:12.960055 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 32743
I20260808 15:57:12.960210 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:57:12.960489 19828 external_mini_cluster.cc:1428] Setting key 8e8dee27655de08f2794fe63f254d7a4
I20260808 15:57:12.962598 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:57:12.965526 507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:12.958646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36459 (local address 127.19.93.3:48573)
0808 15:57:12.958915 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:12.958926 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:12.959015 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:12.959242 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:12.959245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:12.959442 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:12.959589 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:12.959596 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.960644 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.960647 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:12.961351 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:12.961363 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.961743 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.961747 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:12.961841 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:12.962271 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:12.962281 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:12.962646 (+ 365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:12.964185 (+ 1539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:12.964188 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:12.964190 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:12.964419 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:12.964646 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:12.964649 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:12.964651 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:12.964743 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:12.965157 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:12.965159 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:12.965232 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 15:57:12.965305 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 15:57:12.965401 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":1,"thread_start_us":100,"threads_started":1}
I20260808 15:57:12.965624 32228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:12.958708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:48573 (local address 127.19.93.62:36459)
0808 15:57:12.958811 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:12.958815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:12.958990 (+ 175us) server_negotiation.cc:407] Connection header received
0808 15:57:12.959086 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:12.959089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:12.959129 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:12.959204 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:12.959697 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.960459 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.961448 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.961650 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.961728 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:12.962796 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:12.962799 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:12.962801 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:12.962824 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:12.964070 (+ 1246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:12.964502 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:12.964504 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:12.964505 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:12.964573 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:12.964835 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:12.964838 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:12.964840 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:12.965064 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:12.965154 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:12.965374 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 15:57:12.965484 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
Aug 08 15:57:12 dist-test-slave-lgr5 krb5kdc[32077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204632, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 15:57:12 dist-test-slave-lgr5 krb5kdc[32077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:12 dist-test-slave-lgr5 krb5kdc[32077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 15:57:12.986675 32228 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:12.980941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35128 (local address 127.19.93.62:36459)
0808 15:57:12.981053 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:12.981056 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:12.981068 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:57:12.981107 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:12.981109 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:12.981147 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:12.981214 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:12.981865 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.982389 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.983213 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.983434 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.983516 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:12.986526 (+ 3010us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35128: BlockingRecv error: recv got EOF from 127.0.0.1:35128 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 15:57:12 dist-test-slave-lgr5 krb5kdc[32077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204632, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM
I20260808 15:57:12.995178 32228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:12.988021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35142 (local address 127.19.93.62:36459)
0808 15:57:12.988160 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:12.988164 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:12.988324 (+ 160us) server_negotiation.cc:407] Connection header received
0808 15:57:12.988432 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:12.988435 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:12.988476 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:12.988549 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:12.989115 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.989618 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.990382 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:12.990593 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:12.990677 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:12.992744 (+ 2067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:12.992747 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:12.992749 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:12.992771 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:12.993911 (+ 1140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:12.994259 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:12.994261 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:12.994262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:12.994331 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:12.994532 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:12.994534 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:12.994535 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:12.994689 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:12.994780 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:12.994963 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 15:57:12.995051 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 15:57:12.997828 32146 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35142:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:57:13.000788 32146 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:57:13.015048 536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.009508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:33705 (local address 127.0.0.1:37454)
0808 15:57:13.010273 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:13.010285 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:13.010364 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:13.010805 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:13.010808 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:13.010827 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:13.010940 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.010947 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.012525 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.012528 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.013623 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.013633 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.014605 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.014608 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.014688 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.014720 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 15:57:13.014788 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 15:57:13.014898 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":709,"mutex_wait_us":65,"thread_start_us":82,"threads_started":1}
I20260808 15:57:13.015295 538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.009822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:35071 (local address 127.0.0.1:35810)
0808 15:57:13.010947 (+ 1125us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:13.010960 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:13.011044 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:13.011451 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:13.011454 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:13.011470 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:13.011563 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.011570 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.012636 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.012639 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.013871 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.013887 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.014891 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.014894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.014984 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.015006 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 15:57:13.015104 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 15:57:13.015169 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1067,"mutex_wait_us":36,"thread_start_us":96,"threads_started":1}
I20260808 15:57:13.015080 539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.009900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37454 (local address 127.19.93.1:33705)
0808 15:57:13.010419 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.010431 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.010450 (+ 19us) server_negotiation.cc:407] Connection header received
0808 15:57:13.010509 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.010513 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.010666 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.010813 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:13.011054 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.012246 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.013745 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.014472 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.014593 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.014766 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.014822 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.014918 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":72,"threads_started":1}
I20260808 15:57:13.016448 540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.009993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35810 (local address 127.19.93.2:35071)
0808 15:57:13.010601 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.010613 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.011136 (+ 523us) server_negotiation.cc:407] Connection header received
0808 15:57:13.011200 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.011204 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.011326 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.011449 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:13.011667 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.012505 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.013996 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.014768 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.014875 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.015018 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.015472 (+ 454us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.015552 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":125,"threads_started":1}
I20260808 15:57:13.016697 535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.009260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37582 (local address 127.19.93.3:38959)
0808 15:57:13.010212 (+ 952us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.010225 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.010250 (+ 25us) server_negotiation.cc:407] Connection header received
0808 15:57:13.010329 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.010335 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.010549 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.010704 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:13.011008 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.012246 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.015109 (+ 2863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.015914 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.016017 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.016213 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.016462 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.016561 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":840,"thread_start_us":134,"threads_started":1}
I20260808 15:57:13.016997 534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.009140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:38959 (local address 127.0.0.1:37582)
0808 15:57:13.009490 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:13.009549 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:13.009681 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:13.010712 (+ 1031us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:13.010720 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:13.010743 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:13.010882 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.010890 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.012355 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.012359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.013870 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.013882 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.016021 (+ 2139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.016025 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.016320 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.016344 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:57:13.016421 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 15:57:13.016489 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":54,"thread_start_us":86,"threads_started":1}
I20260808 15:57:13.018536 32354 tablet_service.cc:1467] Processing CreateTablet for tablet e89e8660cc90408fb89fc498c95e418a (DEFAULT_TABLE table=test-table [id=31ebad2947e6467fa664c40df38b12e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:13.018898 32604 tablet_service.cc:1467] Processing CreateTablet for tablet e89e8660cc90408fb89fc498c95e418a (DEFAULT_TABLE table=test-table [id=31ebad2947e6467fa664c40df38b12e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:13.019496 32354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89e8660cc90408fb89fc498c95e418a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:13.019866 32604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89e8660cc90408fb89fc498c95e418a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:13.019531 394 tablet_service.cc:1467] Processing CreateTablet for tablet e89e8660cc90408fb89fc498c95e418a (DEFAULT_TABLE table=test-table [id=31ebad2947e6467fa664c40df38b12e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:13.020470 394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89e8660cc90408fb89fc498c95e418a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:13.025990 541 tablet_bootstrap.cc:492] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c: Bootstrap starting.
I20260808 15:57:13.027333 542 tablet_bootstrap.cc:492] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85: Bootstrap starting.
I20260808 15:57:13.028306 541 tablet_bootstrap.cc:654] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:13.028368 544 tablet_bootstrap.cc:492] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c: Bootstrap starting.
I20260808 15:57:13.029170 541 log.cc:824] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:13.029397 542 tablet_bootstrap.cc:654] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:13.030108 542 log.cc:824] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:13.030182 544 tablet_bootstrap.cc:654] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:13.030947 544 log.cc:824] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:13.031410 541 tablet_bootstrap.cc:492] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c: No bootstrap required, opened a new log
I20260808 15:57:13.031616 541 ts_tablet_manager.cc:1397] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:57:13.032701 544 tablet_bootstrap.cc:492] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c: No bootstrap required, opened a new log
I20260808 15:57:13.032830 542 tablet_bootstrap.cc:492] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85: No bootstrap required, opened a new log
I20260808 15:57:13.032866 544 ts_tablet_manager.cc:1397] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 15:57:13.033006 542 ts_tablet_manager.cc:1397] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260808 15:57:13.035470 544 raft_consensus.cc:348] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } }
I20260808 15:57:13.035410 541 raft_consensus.cc:348] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } }
I20260808 15:57:13.035661 544 raft_consensus.cc:374] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:13.035665 541 raft_consensus.cc:374] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:13.035713 541 raft_consensus.cc:729] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef9750d84e74b9b8fded942e7d7c81c, State: Initialized, Role: FOLLOWER
I20260808 15:57:13.035722 544 raft_consensus.cc:729] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad1162ddbe6f480e8d7c5cc5efe5d26c, State: Initialized, Role: FOLLOWER
I20260808 15:57:13.036157 544 consensus_queue.cc:260] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } }
I20260808 15:57:13.036156 541 consensus_queue.cc:260] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } }
I20260808 15:57:13.036755 32462 heartbeater.cc:503] Master 127.19.93.62:36459 was elected leader, sending a full tablet report...
I20260808 15:57:13.036662 542 raft_consensus.cc:348] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } }
I20260808 15:57:13.036887 542 raft_consensus.cc:374] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:13.036944 542 raft_consensus.cc:729] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0b862dff21c4a96858014a1afd77d85, State: Initialized, Role: FOLLOWER
I20260808 15:57:13.037113 541 ts_tablet_manager.cc:1428] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 15:57:13.037360 542 consensus_queue.cc:260] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } }
I20260808 15:57:13.037674 544 ts_tablet_manager.cc:1428] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 15:57:13.037976 32732 heartbeater.cc:503] Master 127.19.93.62:36459 was elected leader, sending a full tablet report...
I20260808 15:57:13.037217 549 raft_consensus.cc:482] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:57:13.038215 549 raft_consensus.cc:504] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } }
I20260808 15:57:13.038390 499 heartbeater.cc:503] Master 127.19.93.62:36459 was elected leader, sending a full tablet report...
I20260808 15:57:13.039621 542 ts_tablet_manager.cc:1428] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260808 15:57:13.039665 32465 tablet.cc:2369] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:57:13.040266 549 leader_election.cc:288] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0b862dff21c4a96858014a1afd77d85 (127.19.93.3:38959), ad1162ddbe6f480e8d7c5cc5efe5d26c (127.19.93.2:35071)
I20260808 15:57:13.044317 32295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.039574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:38959 (local address 127.19.93.1:51043)
0808 15:57:13.040207 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:13.040221 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:13.040301 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:13.040742 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:13.040745 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:13.040762 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:13.040868 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.040876 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.041967 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.041970 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.042956 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.042966 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.043899 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.043903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.043996 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.044018 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 15:57:13.044144 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 15:57:13.044212 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561}
I20260808 15:57:13.044344 535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.040138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:51043 (local address 127.19.93.3:38959)
0808 15:57:13.040240 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.040244 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.040259 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:57:13.040424 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.040427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.040471 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.040535 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:13.041005 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.041723 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.043078 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.043665 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.043783 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.043843 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.044163 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.044237 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 15:57:13.044855 430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e89e8660cc90408fb89fc498c95e418a" candidate_uuid: "eef9750d84e74b9b8fded942e7d7c81c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0b862dff21c4a96858014a1afd77d85" is_pre_election: true
I20260808 15:57:13.045082 430 raft_consensus.cc:2454] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eef9750d84e74b9b8fded942e7d7c81c in term 0.
I20260808 15:57:13.045190 552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.040019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:35071 (local address 127.19.93.1:47073)
0808 15:57:13.040404 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:13.040417 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:13.040514 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:13.040871 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:13.040873 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:13.040891 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:13.041632 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.041640 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.042567 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.042569 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.044144 (+ 1575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.044153 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.044826 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.044830 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.044930 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.044949 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 15:57:13.045018 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 15:57:13.045081 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":134,"threads_started":1}
I20260808 15:57:13.045218 540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.040146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:47073 (local address 127.19.93.2:35071)
0808 15:57:13.040240 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.040244 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.040477 (+ 233us) server_negotiation.cc:407] Connection header received
0808 15:57:13.040644 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.040647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.040690 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.040736 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:13.041757 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.042429 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.044244 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.044699 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.044795 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.044847 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.045042 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.045117 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 15:57:13.045553 32282 leader_election.cc:302] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0b862dff21c4a96858014a1afd77d85, eef9750d84e74b9b8fded942e7d7c81c; no voters:
I20260808 15:57:13.045775 549 raft_consensus.cc:2781] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:57:13.045863 549 raft_consensus.cc:482] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:57:13.045910 549 raft_consensus.cc:3037] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:13.046157 32637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e89e8660cc90408fb89fc498c95e418a" candidate_uuid: "eef9750d84e74b9b8fded942e7d7c81c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" is_pre_election: true
I20260808 15:57:13.046334 32637 raft_consensus.cc:2454] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eef9750d84e74b9b8fded942e7d7c81c in term 0.
I20260808 15:57:13.046944 549 raft_consensus.cc:504] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } }
I20260808 15:57:13.047221 549 leader_election.cc:288] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [CANDIDATE]: Term 1 election: Requested vote from peers a0b862dff21c4a96858014a1afd77d85 (127.19.93.3:38959), ad1162ddbe6f480e8d7c5cc5efe5d26c (127.19.93.2:35071)
I20260808 15:57:13.047529 430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e89e8660cc90408fb89fc498c95e418a" candidate_uuid: "eef9750d84e74b9b8fded942e7d7c81c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0b862dff21c4a96858014a1afd77d85"
I20260808 15:57:13.047549 32637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e89e8660cc90408fb89fc498c95e418a" candidate_uuid: "eef9750d84e74b9b8fded942e7d7c81c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c"
I20260808 15:57:13.047631 32637 raft_consensus.cc:3037] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:13.047631 430 raft_consensus.cc:3037] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:13.048570 430 raft_consensus.cc:2454] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eef9750d84e74b9b8fded942e7d7c81c in term 1.
I20260808 15:57:13.048840 32637 raft_consensus.cc:2454] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eef9750d84e74b9b8fded942e7d7c81c in term 1.
I20260808 15:57:13.048864 32282 leader_election.cc:302] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0b862dff21c4a96858014a1afd77d85, eef9750d84e74b9b8fded942e7d7c81c; no voters:
I20260808 15:57:13.049011 549 raft_consensus.cc:2781] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:13.049248 549 raft_consensus.cc:686] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [term 1 LEADER]: Becoming Leader. State: Replica: eef9750d84e74b9b8fded942e7d7c81c, State: Running, Role: LEADER
I20260808 15:57:13.049516 549 consensus_queue.cc:237] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } }
I20260808 15:57:13.052202 32145 catalog_manager.cc:5495] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c reported cstate change: term changed from 0 to 1, leader changed from <none> to eef9750d84e74b9b8fded942e7d7c81c (127.19.93.1). New cstate: current_term: 1 leader_uuid: "eef9750d84e74b9b8fded942e7d7c81c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } health_report { overall_health: HEALTHY } } }
I20260808 15:57:13.062700 539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.059924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37458 (local address 127.19.93.1:33705)
0808 15:57:13.060021 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.060025 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.060035 (+ 10us) server_negotiation.cc:407] Connection header received
0808 15:57:13.060210 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.060212 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.060258 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.060337 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:57:13.060501 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.060946 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.061668 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.061856 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.061923 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.062110 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:57:13.062460 (+ 350us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:57:13.062536 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.062575 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.062614 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 15:57:13.067440 32637 raft_consensus.cc:1261] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 FOLLOWER]: Refusing update from remote peer eef9750d84e74b9b8fded942e7d7c81c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:13.067476 430 raft_consensus.cc:1261] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Refusing update from remote peer eef9750d84e74b9b8fded942e7d7c81c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:13.067996 549 consensus_queue.cc:1035] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:13.068195 553 consensus_queue.cc:1035] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:13.074641 559 mvcc.cc:205] Tried to move back new op lower bound from 7316294177038372864 to 7316294176973058048. Current Snapshot: MvccSnapshot[applied={T|T < 7316294177038372864}]
I20260808 15:57:13.077021 560 mvcc.cc:205] Tried to move back new op lower bound from 7316294177038372864 to 7316294176973058048. Current Snapshot: MvccSnapshot[applied={T|T < 7316294177038372864}]
I20260808 15:57:13.077644 562 mvcc.cc:205] Tried to move back new op lower bound from 7316294177038372864 to 7316294176973058048. Current Snapshot: MvccSnapshot[applied={T|T < 7316294177038372864}]
I20260808 15:57:13.082779 32148 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:13.082909 32148 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:13.085063 32148 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e: Sending DeleteTablet for 3 replicas of tablet e89e8660cc90408fb89fc498c95e418a
I20260808 15:57:13.085812 394 tablet_service.cc:1514] Processing DeleteTablet for tablet e89e8660cc90408fb89fc498c95e418a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:13 UTC) from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:37582
I20260808 15:57:13.085806 32604 tablet_service.cc:1514] Processing DeleteTablet for tablet e89e8660cc90408fb89fc498c95e418a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:13 UTC) from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:35810
I20260808 15:57:13.085925 32354 tablet_service.cc:1514] Processing DeleteTablet for tablet e89e8660cc90408fb89fc498c95e418a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:13 UTC) from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:37454
I20260808 15:57:13.086341 573 tablet_replica.cc:330] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c: stopping tablet replica
I20260808 15:57:13.086377 571 tablet_replica.cc:330] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85: stopping tablet replica
I20260808 15:57:13.086637 573 raft_consensus.cc:2229] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:57:13.086834 571 raft_consensus.cc:2229] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:13.086894 32148 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35142:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 15:57:13.086997 573 raft_consensus.cc:2258] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 15:57:13.087286 32148 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:57:13.087406 571 raft_consensus.cc:2258] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:13.087998 572 tablet_replica.cc:330] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c: stopping tablet replica
I20260808 15:57:13.088253 572 raft_consensus.cc:2229] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:13.088501 572 raft_consensus.cc:2258] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:13.088946 571 ts_tablet_manager.cc:1905] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:13.089110 573 ts_tablet_manager.cc:1905] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:13.091585 571 ts_tablet_manager.cc:1918] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:13.091681 571 log.cc:1196] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/e89e8660cc90408fb89fc498c95e418a
I20260808 15:57:13.092000 571 ts_tablet_manager.cc:1939] T e89e8660cc90408fb89fc498c95e418a P a0b862dff21c4a96858014a1afd77d85: Deleting consensus metadata
I20260808 15:57:13.092511 32354 tablet_service.cc:1467] Processing CreateTablet for tablet 001a1ebe699341e79078573a9da8fa4a (DEFAULT_TABLE table=test-table [id=c0d9146f0fbb42df814618cf3252d4a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:13.093091 394 tablet_service.cc:1467] Processing CreateTablet for tablet 001a1ebe699341e79078573a9da8fa4a (DEFAULT_TABLE table=test-table [id=c0d9146f0fbb42df814618cf3252d4a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:13.093129 32129 catalog_manager.cc:4841] TS a0b862dff21c4a96858014a1afd77d85 (127.19.93.3:38959): tablet e89e8660cc90408fb89fc498c95e418a (table test-table [id=31ebad2947e6467fa664c40df38b12e4]) successfully deleted
I20260808 15:57:13.093199 32604 tablet_service.cc:1467] Processing CreateTablet for tablet 001a1ebe699341e79078573a9da8fa4a (DEFAULT_TABLE table=test-table [id=c0d9146f0fbb42df814618cf3252d4a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:13.093331 394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 001a1ebe699341e79078573a9da8fa4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:13.093442 32604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 001a1ebe699341e79078573a9da8fa4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:13.093539 32354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 001a1ebe699341e79078573a9da8fa4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:13.095454 542 tablet_bootstrap.cc:492] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85: Bootstrap starting.
I20260808 15:57:13.095676 544 tablet_bootstrap.cc:492] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c: Bootstrap starting.
I20260808 15:57:13.095750 541 tablet_bootstrap.cc:492] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c: Bootstrap starting.
I20260808 15:57:13.096403 542 tablet_bootstrap.cc:654] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:13.096622 541 tablet_bootstrap.cc:654] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:13.096622 544 tablet_bootstrap.cc:654] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:13.097900 544 tablet_bootstrap.cc:492] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c: No bootstrap required, opened a new log
I20260808 15:57:13.097987 544 ts_tablet_manager.cc:1397] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 15:57:13.098426 544 raft_consensus.cc:348] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.098549 544 raft_consensus.cc:374] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:13.098591 544 raft_consensus.cc:729] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad1162ddbe6f480e8d7c5cc5efe5d26c, State: Initialized, Role: FOLLOWER
I20260808 15:57:13.098718 544 consensus_queue.cc:260] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.098986 544 ts_tablet_manager.cc:1428] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 15:57:13.099584 573 ts_tablet_manager.cc:1918] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:13.099673 573 log.cc:1196] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/wal/wals/e89e8660cc90408fb89fc498c95e418a
I20260808 15:57:13.099982 573 ts_tablet_manager.cc:1939] T e89e8660cc90408fb89fc498c95e418a P eef9750d84e74b9b8fded942e7d7c81c: Deleting consensus metadata
I20260808 15:57:13.100999 32131 catalog_manager.cc:4841] TS eef9750d84e74b9b8fded942e7d7c81c (127.19.93.1:33705): tablet e89e8660cc90408fb89fc498c95e418a (table test-table [id=31ebad2947e6467fa664c40df38b12e4]) successfully deleted
I20260808 15:57:13.101399 572 ts_tablet_manager.cc:1905] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:13.103324 572 ts_tablet_manager.cc:1918] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:13.103422 572 log.cc:1196] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/e89e8660cc90408fb89fc498c95e418a
I20260808 15:57:13.103683 572 ts_tablet_manager.cc:1939] T e89e8660cc90408fb89fc498c95e418a P ad1162ddbe6f480e8d7c5cc5efe5d26c: Deleting consensus metadata
I20260808 15:57:13.104786 32129 catalog_manager.cc:4841] TS ad1162ddbe6f480e8d7c5cc5efe5d26c (127.19.93.2:35071): tablet e89e8660cc90408fb89fc498c95e418a (table test-table [id=31ebad2947e6467fa664c40df38b12e4]) successfully deleted
I20260808 15:57:13.104959 541 tablet_bootstrap.cc:492] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c: No bootstrap required, opened a new log
I20260808 15:57:13.105032 541 ts_tablet_manager.cc:1397] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260808 15:57:13.105374 542 tablet_bootstrap.cc:492] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85: No bootstrap required, opened a new log
I20260808 15:57:13.105458 542 ts_tablet_manager.cc:1397] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20260808 15:57:13.105468 541 raft_consensus.cc:348] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.105573 541 raft_consensus.cc:374] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:13.105609 541 raft_consensus.cc:729] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef9750d84e74b9b8fded942e7d7c81c, State: Initialized, Role: FOLLOWER
I20260808 15:57:13.105722 541 consensus_queue.cc:260] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.105886 542 raft_consensus.cc:348] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.105965 541 ts_tablet_manager.cc:1428] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 15:57:13.105981 542 raft_consensus.cc:374] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:13.106022 542 raft_consensus.cc:729] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0b862dff21c4a96858014a1afd77d85, State: Initialized, Role: FOLLOWER
I20260808 15:57:13.106149 542 consensus_queue.cc:260] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.106371 542 ts_tablet_manager.cc:1428] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 15:57:13.193454 550 raft_consensus.cc:482] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:57:13.193622 550 raft_consensus.cc:504] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.194716 550 leader_election.cc:288] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eef9750d84e74b9b8fded942e7d7c81c (127.19.93.1:33705), a0b862dff21c4a96858014a1afd77d85 (127.19.93.3:38959)
I20260808 15:57:13.199460 32532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.194957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:33705 (local address 127.19.93.2:36937)
0808 15:57:13.195131 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:13.195148 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:13.195247 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:13.195772 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:13.195775 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:13.195793 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:13.195918 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.195926 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.196961 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.196964 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.198278 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.198292 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.198993 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.198997 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.199110 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.199137 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 15:57:13.199220 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 15:57:13.199296 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":33}
I20260808 15:57:13.199533 539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.195391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:36937 (local address 127.19.93.1:33705)
0808 15:57:13.195545 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.195550 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.195567 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:57:13.195623 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.195626 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.195677 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.195753 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:13.196062 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.196839 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.198457 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.198868 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.198977 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.199053 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.199327 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.199408 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 15:57:13.199666 535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.195270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:44761 (local address 127.19.93.3:38959)
0808 15:57:13.195409 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.195414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.195589 (+ 175us) server_negotiation.cc:407] Connection header received
0808 15:57:13.195694 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.195698 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.195750 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.195833 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:13.196188 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.196703 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.198438 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.199058 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.199181 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.199245 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.199452 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.199541 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 15:57:13.200047 579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.194986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:38959 (local address 127.19.93.2:44761)
0808 15:57:13.195471 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:13.195485 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:13.195598 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:13.195900 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:13.195902 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:13.195918 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:13.196051 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.196059 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.196828 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.196832 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.198278 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.198292 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.199202 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.199206 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.199296 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.199319 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:57:13.199798 (+ 479us) client_negotiation.cc:240] Negotiation successful
0808 15:57:13.199885 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"mutex_wait_us":67,"thread_start_us":144,"threads_started":1}
I20260808 15:57:13.200475 32387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "001a1ebe699341e79078573a9da8fa4a" candidate_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef9750d84e74b9b8fded942e7d7c81c" is_pre_election: true
I20260808 15:57:13.200544 430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "001a1ebe699341e79078573a9da8fa4a" candidate_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0b862dff21c4a96858014a1afd77d85" is_pre_election: true
I20260808 15:57:13.200697 430 raft_consensus.cc:2454] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad1162ddbe6f480e8d7c5cc5efe5d26c in term 0.
I20260808 15:57:13.200714 32387 raft_consensus.cc:2454] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad1162ddbe6f480e8d7c5cc5efe5d26c in term 0.
I20260808 15:57:13.201089 32522 leader_election.cc:302] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0b862dff21c4a96858014a1afd77d85, ad1162ddbe6f480e8d7c5cc5efe5d26c; no voters:
I20260808 15:57:13.201368 550 raft_consensus.cc:2781] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:57:13.201442 550 raft_consensus.cc:482] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:57:13.201486 550 raft_consensus.cc:3037] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:13.202499 550 raft_consensus.cc:504] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.202862 550 leader_election.cc:288] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [CANDIDATE]: Term 1 election: Requested vote from peers eef9750d84e74b9b8fded942e7d7c81c (127.19.93.1:33705), a0b862dff21c4a96858014a1afd77d85 (127.19.93.3:38959)
I20260808 15:57:13.203225 32387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "001a1ebe699341e79078573a9da8fa4a" candidate_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef9750d84e74b9b8fded942e7d7c81c"
I20260808 15:57:13.203398 32387 raft_consensus.cc:3037] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Advancing to term 1
W20260808 15:57:13.203526 500 tablet.cc:2369] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:57:13.204195 430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "001a1ebe699341e79078573a9da8fa4a" candidate_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0b862dff21c4a96858014a1afd77d85"
I20260808 15:57:13.204321 430 raft_consensus.cc:3037] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:13.204694 32387 raft_consensus.cc:2454] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad1162ddbe6f480e8d7c5cc5efe5d26c in term 1.
I20260808 15:57:13.205029 32523 leader_election.cc:302] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad1162ddbe6f480e8d7c5cc5efe5d26c, eef9750d84e74b9b8fded942e7d7c81c; no voters:
I20260808 15:57:13.205302 550 raft_consensus.cc:2781] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:13.205422 430 raft_consensus.cc:2454] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad1162ddbe6f480e8d7c5cc5efe5d26c in term 1.
I20260808 15:57:13.205530 550 raft_consensus.cc:686] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 LEADER]: Becoming Leader. State: Replica: ad1162ddbe6f480e8d7c5cc5efe5d26c, State: Running, Role: LEADER
I20260808 15:57:13.205796 550 consensus_queue.cc:237] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.208282 32148 catalog_manager.cc:5495] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c reported cstate change: term changed from 0 to 1, leader changed from <none> to ad1162ddbe6f480e8d7c5cc5efe5d26c (127.19.93.2). New cstate: current_term: 1 leader_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } health_report { overall_health: UNKNOWN } } }
Aug 08 15:57:13 dist-test-slave-lgr5 krb5kdc[32077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204632, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.62@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM
I20260808 15:57:13.245246 590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.237557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36459 (local address 127.0.0.1:35156)
0808 15:57:13.237817 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:13.237831 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:13.237936 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:13.238146 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:13.238148 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:13.238507 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:13.238600 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.238606 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.239267 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.239269 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.239818 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.239824 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.240207 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.240209 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.240284 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.240814 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:13.240825 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:13.242262 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:13.243873 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:13.243884 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:13.243890 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:13.244194 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:13.244442 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:13.244444 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:13.244445 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:13.244523 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:13.244795 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:13.244799 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:13.244894 (+ 95us) client_negotiation.cc:769] Sending connection context
0808 15:57:13.244976 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 15:57:13.245090 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":105,"threads_started":1}
I20260808 15:57:13.245271 32228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.237617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35156 (local address 127.19.93.62:36459)
0808 15:57:13.237734 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.237738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.237894 (+ 156us) server_negotiation.cc:407] Connection header received
0808 15:57:13.238012 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.238014 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.238052 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.238121 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:13.238688 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.239191 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.239895 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.240117 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.240188 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.242389 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:13.242392 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:13.242394 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:13.242415 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:13.243775 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:13.244287 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:13.244290 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:13.244292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:13.244367 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:13.244579 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:13.244581 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:13.244582 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:13.244725 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:13.244791 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.245021 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.245148 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":41}
I20260808 15:57:13.248759 32148 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:35156:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 15:57:13.249423 32148 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 15:57:13.250231 32733 tablet.cc:2369] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:57:13.254243 32354 tablet_service.cc:1467] Processing CreateTablet for tablet 3f338730358549b59ef79204ecd20fe8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fab49525fcdf49e48dec593f90608571]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:57:13.254462 394 tablet_service.cc:1467] Processing CreateTablet for tablet 3f338730358549b59ef79204ecd20fe8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fab49525fcdf49e48dec593f90608571]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:57:13.254655 32354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f338730358549b59ef79204ecd20fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:13.254823 394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f338730358549b59ef79204ecd20fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:13.257545 541 tablet_bootstrap.cc:492] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c: Bootstrap starting.
I20260808 15:57:13.257601 542 tablet_bootstrap.cc:492] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85: Bootstrap starting.
I20260808 15:57:13.257892 32604 tablet_service.cc:1467] Processing CreateTablet for tablet 3f338730358549b59ef79204ecd20fe8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fab49525fcdf49e48dec593f90608571]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:57:13.258246 32604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f338730358549b59ef79204ecd20fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:13.258381 541 tablet_bootstrap.cc:654] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:13.258554 542 tablet_bootstrap.cc:654] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:13.259722 542 tablet_bootstrap.cc:492] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85: No bootstrap required, opened a new log
I20260808 15:57:13.259799 542 ts_tablet_manager.cc:1397] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:13.260000 541 tablet_bootstrap.cc:492] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c: No bootstrap required, opened a new log
I20260808 15:57:13.260099 541 ts_tablet_manager.cc:1397] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260808 15:57:13.260226 542 raft_consensus.cc:348] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.260336 542 raft_consensus.cc:374] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:13.260361 542 raft_consensus.cc:729] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0b862dff21c4a96858014a1afd77d85, State: Initialized, Role: FOLLOWER
I20260808 15:57:13.260480 542 consensus_queue.cc:260] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.260509 541 raft_consensus.cc:348] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.260613 541 raft_consensus.cc:374] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:13.260643 541 raft_consensus.cc:729] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef9750d84e74b9b8fded942e7d7c81c, State: Initialized, Role: FOLLOWER
I20260808 15:57:13.260708 542 ts_tablet_manager.cc:1428] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:57:13.260756 541 consensus_queue.cc:260] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.261003 541 ts_tablet_manager.cc:1428] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 15:57:13.260988 551 tablet_replica.cc:439] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } }
I20260808 15:57:13.261126 551 tablet_replica.cc:442] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:57:13.261358 544 tablet_bootstrap.cc:492] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: Bootstrap starting.
I20260808 15:57:13.261799 566 tablet_replica.cc:439] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } }
I20260808 15:57:13.261927 566 tablet_replica.cc:442] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:57:13.262341 544 tablet_bootstrap.cc:654] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:13.263671 544 tablet_bootstrap.cc:492] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: No bootstrap required, opened a new log
I20260808 15:57:13.263761 544 ts_tablet_manager.cc:1397] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 15:57:13.264462 544 raft_consensus.cc:348] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.264585 544 raft_consensus.cc:374] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:13.264611 544 raft_consensus.cc:729] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad1162ddbe6f480e8d7c5cc5efe5d26c, State: Initialized, Role: FOLLOWER
I20260808 15:57:13.264707 544 consensus_queue.cc:260] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.264925 544 ts_tablet_manager.cc:1428] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:57:13.264909 580 tablet_replica.cc:439] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } }
I20260808 15:57:13.265065 580 tablet_replica.cc:442] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:57:13.269469 566 raft_consensus.cc:482] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:57:13.269548 566 raft_consensus.cc:504] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.269896 566 leader_election.cc:288] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad1162ddbe6f480e8d7c5cc5efe5d26c (127.19.93.2:35071), a0b862dff21c4a96858014a1afd77d85 (127.19.93.3:38959)
I20260808 15:57:13.270339 32637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f338730358549b59ef79204ecd20fe8" candidate_uuid: "eef9750d84e74b9b8fded942e7d7c81c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" is_pre_election: true
I20260808 15:57:13.270463 32637 raft_consensus.cc:2454] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eef9750d84e74b9b8fded942e7d7c81c in term 0.
I20260808 15:57:13.270714 430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f338730358549b59ef79204ecd20fe8" candidate_uuid: "eef9750d84e74b9b8fded942e7d7c81c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0b862dff21c4a96858014a1afd77d85" is_pre_election: true
I20260808 15:57:13.270740 32282 leader_election.cc:302] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad1162ddbe6f480e8d7c5cc5efe5d26c, eef9750d84e74b9b8fded942e7d7c81c; no voters:
I20260808 15:57:13.270826 430 raft_consensus.cc:2454] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eef9750d84e74b9b8fded942e7d7c81c in term 0.
I20260808 15:57:13.270889 566 raft_consensus.cc:2781] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:57:13.270941 566 raft_consensus.cc:482] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:57:13.270979 566 raft_consensus.cc:3037] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:13.271903 566 raft_consensus.cc:504] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.272214 566 leader_election.cc:288] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [CANDIDATE]: Term 1 election: Requested vote from peers ad1162ddbe6f480e8d7c5cc5efe5d26c (127.19.93.2:35071), a0b862dff21c4a96858014a1afd77d85 (127.19.93.3:38959)
I20260808 15:57:13.272521 32637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f338730358549b59ef79204ecd20fe8" candidate_uuid: "eef9750d84e74b9b8fded942e7d7c81c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c"
I20260808 15:57:13.272599 430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f338730358549b59ef79204ecd20fe8" candidate_uuid: "eef9750d84e74b9b8fded942e7d7c81c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0b862dff21c4a96858014a1afd77d85"
I20260808 15:57:13.272632 32637 raft_consensus.cc:3037] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:13.272696 430 raft_consensus.cc:3037] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:13.273612 430 raft_consensus.cc:2454] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eef9750d84e74b9b8fded942e7d7c81c in term 1.
I20260808 15:57:13.273604 32637 raft_consensus.cc:2454] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eef9750d84e74b9b8fded942e7d7c81c in term 1.
I20260808 15:57:13.273861 32282 leader_election.cc:302] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0b862dff21c4a96858014a1afd77d85, eef9750d84e74b9b8fded942e7d7c81c; no voters:
I20260808 15:57:13.274112 566 raft_consensus.cc:2781] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:13.274204 566 raft_consensus.cc:686] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [term 1 LEADER]: Becoming Leader. State: Replica: eef9750d84e74b9b8fded942e7d7c81c, State: Running, Role: LEADER
I20260808 15:57:13.274327 566 consensus_queue.cc:237] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.274950 549 tablet_replica.cc:439] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c: TxnStatusTablet state changed. Reason: New leader eef9750d84e74b9b8fded942e7d7c81c. Latest consensus state: current_term: 1 leader_uuid: "eef9750d84e74b9b8fded942e7d7c81c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } }
I20260808 15:57:13.275053 549 tablet_replica.cc:442] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:57:13.275332 596 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 15:57:13.275493 596 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 15:57:13.275893 32145 catalog_manager.cc:5495] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c reported cstate change: term changed from 0 to 1, leader changed from <none> to eef9750d84e74b9b8fded942e7d7c81c (127.19.93.1). New cstate: current_term: 1 leader_uuid: "eef9750d84e74b9b8fded942e7d7c81c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } health_report { overall_health: UNKNOWN } } }
I20260808 15:57:13.287148 539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.283795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37466 (local address 127.19.93.1:33705)
0808 15:57:13.283894 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.283897 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.284041 (+ 144us) server_negotiation.cc:407] Connection header received
0808 15:57:13.284230 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.284232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.284275 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.284334 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:57:13.284575 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.285059 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.286195 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.286393 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.286457 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.286737 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:57:13.286801 (+ 64us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:57:13.286850 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.286988 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.287047 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 15:57:13.287168 590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.283737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:33705 (local address 127.0.0.1:37466)
0808 15:57:13.283973 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:13.283988 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:13.284126 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:13.284373 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:13.284376 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:13.284383 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:57:13.284492 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.284498 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.285153 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.285156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.286100 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.286110 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.286475 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.286478 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.286573 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.286624 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:57:13.286868 (+ 244us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:57:13.286878 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 15:57:13.286940 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 15:57:13.287019 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141}
I20260808 15:57:13.289251 430 raft_consensus.cc:1261] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Refusing update from remote peer eef9750d84e74b9b8fded942e7d7c81c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:13.289454 32637 raft_consensus.cc:1261] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 FOLLOWER]: Refusing update from remote peer eef9750d84e74b9b8fded942e7d7c81c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:13.289698 566 consensus_queue.cc:1035] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:13.289975 566 consensus_queue.cc:1035] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:13.291121 580 tablet_replica.cc:439] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: TxnStatusTablet state changed. Reason: New leader eef9750d84e74b9b8fded942e7d7c81c. Latest consensus state: current_term: 1 leader_uuid: "eef9750d84e74b9b8fded942e7d7c81c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } }
I20260808 15:57:13.291225 580 tablet_replica.cc:442] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:57:13.291218 551 tablet_replica.cc:439] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85: TxnStatusTablet state changed. Reason: New leader eef9750d84e74b9b8fded942e7d7c81c. Latest consensus state: current_term: 1 leader_uuid: "eef9750d84e74b9b8fded942e7d7c81c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } }
I20260808 15:57:13.291332 551 tablet_replica.cc:442] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:57:13.292403 553 tablet_replica.cc:439] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eef9750d84e74b9b8fded942e7d7c81c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } }
I20260808 15:57:13.292517 553 tablet_replica.cc:442] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:57:13.292641 553 tablet_replica.cc:439] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eef9750d84e74b9b8fded942e7d7c81c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } }
I20260808 15:57:13.292704 553 tablet_replica.cc:442] T 3f338730358549b59ef79204ecd20fe8 P eef9750d84e74b9b8fded942e7d7c81c: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:57:13.292750 580 tablet_replica.cc:439] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eef9750d84e74b9b8fded942e7d7c81c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } }
I20260808 15:57:13.292860 580 tablet_replica.cc:442] T 3f338730358549b59ef79204ecd20fe8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:57:13.295075 551 tablet_replica.cc:439] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eef9750d84e74b9b8fded942e7d7c81c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } } }
I20260808 15:57:13.295181 551 tablet_replica.cc:442] T 3f338730358549b59ef79204ecd20fe8 P a0b862dff21c4a96858014a1afd77d85: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:57:13.300688 540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.297439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35824 (local address 127.19.93.2:35071)
0808 15:57:13.297542 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.297546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.297559 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:57:13.297628 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.297631 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.297684 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.297783 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:57:13.297969 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.298517 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.299310 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.299538 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.299624 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.299874 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:57:13.300328 (+ 454us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:57:13.300429 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.300502 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.300552 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 15:57:13.310194 539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.306897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:45311 (local address 127.19.93.1:33705)
0808 15:57:13.307013 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.307018 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.307177 (+ 159us) server_negotiation.cc:407] Connection header received
0808 15:57:13.307293 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.307295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.307332 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.307388 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:57:13.307623 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.308074 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.309295 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.309509 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.309582 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.309855 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:57:13.309912 (+ 57us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:57:13.309956 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.310056 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.310101 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 15:57:13.310264 611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.306811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:33705 (local address 127.19.93.2:45311)
0808 15:57:13.307113 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:13.307126 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:13.307222 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:13.307410 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:13.307413 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:13.307434 (+ 21us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:57:13.307541 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.307547 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.308195 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.308199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.309189 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.309200 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.309607 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.309610 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.309702 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.309751 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:57:13.309980 (+ 229us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:57:13.309986 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:57:13.310039 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 15:57:13.310116 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":87,"threads_started":1}
I20260808 15:57:13.316211 430 raft_consensus.cc:1261] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Refusing update from remote peer ad1162ddbe6f480e8d7c5cc5efe5d26c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:13.316282 32387 raft_consensus.cc:1261] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Refusing update from remote peer ad1162ddbe6f480e8d7c5cc5efe5d26c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:13.316603 580 consensus_queue.cc:1035] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:13.316787 550 consensus_queue.cc:1035] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:13.337738 620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.334136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:35071 (local address 127.19.93.1:54113)
0808 15:57:13.334499 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:13.334510 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:13.334605 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:13.334800 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:13.334802 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:13.334810 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:57:13.334905 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.334911 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.335884 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.335887 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.336609 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.336620 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.337171 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.337173 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.337231 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.337272 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:57:13.337521 (+ 249us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:57:13.337525 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 15:57:13.337568 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 15:57:13.337629 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":98,"threads_started":1}
I20260808 15:57:13.337747 540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.334210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:54113 (local address 127.19.93.2:35071)
0808 15:57:13.334326 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.334331 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.334576 (+ 245us) server_negotiation.cc:407] Connection header received
0808 15:57:13.334682 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.334684 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.334727 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.334784 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:57:13.335016 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.335776 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.336717 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.337062 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.337155 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.337372 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:57:13.337448 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:57:13.337512 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.337579 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.337626 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 15:57:13.359325 32148 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:13.359488 32148 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:13.361579 32148 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e: Sending DeleteTablet for 3 replicas of tablet 001a1ebe699341e79078573a9da8fa4a
I20260808 15:57:13.362051 32354 tablet_service.cc:1514] Processing DeleteTablet for tablet 001a1ebe699341e79078573a9da8fa4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:13 UTC) from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:37454
I20260808 15:57:13.362236 32604 tablet_service.cc:1514] Processing DeleteTablet for tablet 001a1ebe699341e79078573a9da8fa4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:13 UTC) from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:35810
I20260808 15:57:13.362293 573 tablet_replica.cc:330] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c: stopping tablet replica
I20260808 15:57:13.362406 573 raft_consensus.cc:2229] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:13.362511 573 raft_consensus.cc:2258] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:13.362665 572 tablet_replica.cc:330] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c: stopping tablet replica
I20260808 15:57:13.362766 572 raft_consensus.cc:2229] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:57:13.363014 572 raft_consensus.cc:2258] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:13.363281 394 tablet_service.cc:1514] Processing DeleteTablet for tablet 001a1ebe699341e79078573a9da8fa4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:13 UTC) from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:37582
I20260808 15:57:13.363433 571 tablet_replica.cc:330] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85: stopping tablet replica
I20260808 15:57:13.363535 571 raft_consensus.cc:2229] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:13.363642 571 raft_consensus.cc:2258] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:13.363735 572 ts_tablet_manager.cc:1905] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:13.364679 571 ts_tablet_manager.cc:1905] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:13.366451 572 ts_tablet_manager.cc:1918] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:57:13.366514 572 log.cc:1196] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/001a1ebe699341e79078573a9da8fa4a
I20260808 15:57:13.366753 572 ts_tablet_manager.cc:1939] T 001a1ebe699341e79078573a9da8fa4a P ad1162ddbe6f480e8d7c5cc5efe5d26c: Deleting consensus metadata
I20260808 15:57:13.367302 571 ts_tablet_manager.cc:1918] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:57:13.367365 571 log.cc:1196] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/001a1ebe699341e79078573a9da8fa4a
I20260808 15:57:13.367336 32129 catalog_manager.cc:4841] TS ad1162ddbe6f480e8d7c5cc5efe5d26c (127.19.93.2:35071): tablet 001a1ebe699341e79078573a9da8fa4a (table test-table [id=c0d9146f0fbb42df814618cf3252d4a0]) successfully deleted
I20260808 15:57:13.367599 571 ts_tablet_manager.cc:1939] T 001a1ebe699341e79078573a9da8fa4a P a0b862dff21c4a96858014a1afd77d85: Deleting consensus metadata
I20260808 15:57:13.368173 32129 catalog_manager.cc:4841] TS a0b862dff21c4a96858014a1afd77d85 (127.19.93.3:38959): tablet 001a1ebe699341e79078573a9da8fa4a (table test-table [id=c0d9146f0fbb42df814618cf3252d4a0]) successfully deleted
I20260808 15:57:13.368851 573 ts_tablet_manager.cc:1905] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:13.371448 573 ts_tablet_manager.cc:1918] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:57:13.371526 573 log.cc:1196] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/wal/wals/001a1ebe699341e79078573a9da8fa4a
I20260808 15:57:13.371749 573 ts_tablet_manager.cc:1939] T 001a1ebe699341e79078573a9da8fa4a P eef9750d84e74b9b8fded942e7d7c81c: Deleting consensus metadata
I20260808 15:57:13.372440 32131 catalog_manager.cc:4841] TS eef9750d84e74b9b8fded942e7d7c81c (127.19.93.1:33705): tablet 001a1ebe699341e79078573a9da8fa4a (table test-table [id=c0d9146f0fbb42df814618cf3252d4a0]) successfully deleted
Aug 08 15:57:13 dist-test-slave-lgr5 krb5kdc[32077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204633, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 15:57:13 dist-test-slave-lgr5 krb5kdc[32077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:13 dist-test-slave-lgr5 krb5kdc[32077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 15:57:13.401212 32228 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:13.393465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35166 (local address 127.19.93.62:36459)
0808 15:57:13.393605 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.393609 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.393883 (+ 274us) server_negotiation.cc:407] Connection header received
0808 15:57:13.394024 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.394027 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.394082 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.394166 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:13.394995 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.395829 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.397108 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.397434 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.397543 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.401082 (+ 3539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35166: BlockingRecv error: recv got EOF from 127.0.0.1:35166 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 15:57:13 dist-test-slave-lgr5 krb5kdc[32077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204633, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM
I20260808 15:57:13.412334 32228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.402656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35174 (local address 127.19.93.62:36459)
0808 15:57:13.402753 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.402757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.402939 (+ 182us) server_negotiation.cc:407] Connection header received
0808 15:57:13.403071 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.403075 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.403141 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.403217 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:13.403920 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.404742 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.405853 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.406186 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.406281 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.409228 (+ 2947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:13.409232 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:13.409234 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:13.409261 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:13.410771 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:13.411194 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:13.411197 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:13.411199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:13.411277 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:13.411525 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:13.411528 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:13.411530 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:13.411719 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:13.411841 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.412041 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.412177 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 15:57:13.414995 32148 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35174:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:57:13.415484 32148 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:57:13.420867 32354 tablet_service.cc:1467] Processing CreateTablet for tablet 1cf1071aefd04dbf8b0177472ccec7f8 (DEFAULT_TABLE table=test-table [id=6e3902cd7c3b4fbe83683b6ee8771b23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:13.421167 32354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cf1071aefd04dbf8b0177472ccec7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:13.423868 541 tablet_bootstrap.cc:492] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c: Bootstrap starting.
I20260808 15:57:13.424049 394 tablet_service.cc:1467] Processing CreateTablet for tablet 1cf1071aefd04dbf8b0177472ccec7f8 (DEFAULT_TABLE table=test-table [id=6e3902cd7c3b4fbe83683b6ee8771b23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:13.424431 394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cf1071aefd04dbf8b0177472ccec7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:13.424712 541 tablet_bootstrap.cc:654] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:13.426496 541 tablet_bootstrap.cc:492] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c: No bootstrap required, opened a new log
I20260808 15:57:13.426579 541 ts_tablet_manager.cc:1397] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 15:57:13.426937 32604 tablet_service.cc:1467] Processing CreateTablet for tablet 1cf1071aefd04dbf8b0177472ccec7f8 (DEFAULT_TABLE table=test-table [id=6e3902cd7c3b4fbe83683b6ee8771b23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:13.426952 541 raft_consensus.cc:348] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.427054 541 raft_consensus.cc:374] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:13.427083 541 raft_consensus.cc:729] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef9750d84e74b9b8fded942e7d7c81c, State: Initialized, Role: FOLLOWER
I20260808 15:57:13.427176 32604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cf1071aefd04dbf8b0177472ccec7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:13.427192 541 consensus_queue.cc:260] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.427433 541 ts_tablet_manager.cc:1428] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:57:13.428210 542 tablet_bootstrap.cc:492] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85: Bootstrap starting.
I20260808 15:57:13.429105 542 tablet_bootstrap.cc:654] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:13.432314 544 tablet_bootstrap.cc:492] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: Bootstrap starting.
I20260808 15:57:13.432571 542 tablet_bootstrap.cc:492] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85: No bootstrap required, opened a new log
I20260808 15:57:13.432646 542 ts_tablet_manager.cc:1397] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 15:57:13.433058 542 raft_consensus.cc:348] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.433158 542 raft_consensus.cc:374] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:13.433173 544 tablet_bootstrap.cc:654] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:13.433187 542 raft_consensus.cc:729] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0b862dff21c4a96858014a1afd77d85, State: Initialized, Role: FOLLOWER
I20260808 15:57:13.433287 542 consensus_queue.cc:260] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.433523 542 ts_tablet_manager.cc:1428] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:57:13.435703 544 tablet_bootstrap.cc:492] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: No bootstrap required, opened a new log
I20260808 15:57:13.435782 544 ts_tablet_manager.cc:1397] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 15:57:13.436197 544 raft_consensus.cc:348] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.436293 544 raft_consensus.cc:374] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:13.436321 544 raft_consensus.cc:729] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad1162ddbe6f480e8d7c5cc5efe5d26c, State: Initialized, Role: FOLLOWER
I20260808 15:57:13.436431 544 consensus_queue.cc:260] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.436678 544 ts_tablet_manager.cc:1428] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 15:57:13.571677 551 raft_consensus.cc:482] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:57:13.571810 551 raft_consensus.cc:504] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.572860 551 leader_election.cc:288] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eef9750d84e74b9b8fded942e7d7c81c (127.19.93.1:33705), ad1162ddbe6f480e8d7c5cc5efe5d26c (127.19.93.2:35071)
I20260808 15:57:13.577198 539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.573176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:59715 (local address 127.19.93.1:33705)
0808 15:57:13.573310 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.573315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.573458 (+ 143us) server_negotiation.cc:407] Connection header received
0808 15:57:13.573602 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.573605 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.573656 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.573737 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:13.574005 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.574604 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.575972 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.576568 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.576663 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.576725 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.577005 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.577074 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 15:57:13.577198 540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.573200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:36357 (local address 127.19.93.2:35071)
0808 15:57:13.573329 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.573333 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.573737 (+ 404us) server_negotiation.cc:407] Connection header received
0808 15:57:13.573831 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.573834 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.573881 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.573955 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:13.574219 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.574697 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.575915 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.576550 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.576663 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.576729 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.577005 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.577074 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 15:57:13.577244 645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.573091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:35071 (local address 127.19.93.3:36357)
0808 15:57:13.573632 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:13.573645 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:13.573745 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:13.573982 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:13.573985 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:13.574003 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:13.574115 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.574120 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.574805 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.574807 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.575785 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.575795 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.576675 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.576679 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.576845 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.576904 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 15:57:13.576983 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 15:57:13.577065 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"mutex_wait_us":322,"thread_start_us":77,"threads_started":1}
I20260808 15:57:13.577246 644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.573091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:33705 (local address 127.19.93.3:59715)
0808 15:57:13.573361 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:13.573376 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:13.573495 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:13.573751 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:13.573754 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:13.573776 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:13.573907 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.573914 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.574717 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.574721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.575806 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:13.575819 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.576675 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.576679 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:13.576845 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.576904 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 15:57:13.576983 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 15:57:13.577065 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":120,"thread_start_us":88,"threads_started":1}
I20260808 15:57:13.577652 32637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cf1071aefd04dbf8b0177472ccec7f8" candidate_uuid: "a0b862dff21c4a96858014a1afd77d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" is_pre_election: true
I20260808 15:57:13.577813 32637 raft_consensus.cc:2454] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0b862dff21c4a96858014a1afd77d85 in term 0.
I20260808 15:57:13.578013 32387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cf1071aefd04dbf8b0177472ccec7f8" candidate_uuid: "a0b862dff21c4a96858014a1afd77d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef9750d84e74b9b8fded942e7d7c81c" is_pre_election: true
I20260808 15:57:13.578154 32387 raft_consensus.cc:2454] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0b862dff21c4a96858014a1afd77d85 in term 0.
I20260808 15:57:13.578164 308 leader_election.cc:302] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0b862dff21c4a96858014a1afd77d85, ad1162ddbe6f480e8d7c5cc5efe5d26c; no voters:
I20260808 15:57:13.578428 551 raft_consensus.cc:2781] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:57:13.578490 551 raft_consensus.cc:482] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:57:13.578516 551 raft_consensus.cc:3037] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:13.579501 551 raft_consensus.cc:504] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.579823 551 leader_election.cc:288] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [CANDIDATE]: Term 1 election: Requested vote from peers eef9750d84e74b9b8fded942e7d7c81c (127.19.93.1:33705), ad1162ddbe6f480e8d7c5cc5efe5d26c (127.19.93.2:35071)
I20260808 15:57:13.580180 32637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cf1071aefd04dbf8b0177472ccec7f8" candidate_uuid: "a0b862dff21c4a96858014a1afd77d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c"
I20260808 15:57:13.580180 32387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cf1071aefd04dbf8b0177472ccec7f8" candidate_uuid: "a0b862dff21c4a96858014a1afd77d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef9750d84e74b9b8fded942e7d7c81c"
I20260808 15:57:13.580295 32387 raft_consensus.cc:3037] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:13.580296 32637 raft_consensus.cc:3037] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:13.581368 32387 raft_consensus.cc:2454] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0b862dff21c4a96858014a1afd77d85 in term 1.
I20260808 15:57:13.581367 32637 raft_consensus.cc:2454] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0b862dff21c4a96858014a1afd77d85 in term 1.
I20260808 15:57:13.581631 308 leader_election.cc:302] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: a0b862dff21c4a96858014a1afd77d85, ad1162ddbe6f480e8d7c5cc5efe5d26c, eef9750d84e74b9b8fded942e7d7c81c; no voters:
I20260808 15:57:13.581821 551 raft_consensus.cc:2781] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:13.582026 551 raft_consensus.cc:686] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [term 1 LEADER]: Becoming Leader. State: Replica: a0b862dff21c4a96858014a1afd77d85, State: Running, Role: LEADER
I20260808 15:57:13.582273 551 consensus_queue.cc:237] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.584491 32146 catalog_manager.cc:5495] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0b862dff21c4a96858014a1afd77d85 (127.19.93.3). New cstate: current_term: 1 leader_uuid: "a0b862dff21c4a96858014a1afd77d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } health_report { overall_health: HEALTHY } } }
I20260808 15:57:13.621611 535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.618112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37584 (local address 127.19.93.3:38959)
0808 15:57:13.618230 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.618235 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.618252 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:57:13.618359 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.618361 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.618418 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.618555 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:57:13.618765 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.619298 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.620213 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.620427 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.620514 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.620775 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:57:13.621222 (+ 447us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:57:13.621323 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.621406 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.621456 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:57:13.624153 32637 raft_consensus.cc:1261] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 FOLLOWER]: Refusing update from remote peer a0b862dff21c4a96858014a1afd77d85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:13.624153 32387 raft_consensus.cc:1261] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Refusing update from remote peer a0b862dff21c4a96858014a1afd77d85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:13.624617 551 consensus_queue.cc:1035] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:13.624836 646 consensus_queue.cc:1035] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:13.635519 32146 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:13.635634 32146 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:13.637374 32146 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e: Sending DeleteTablet for 3 replicas of tablet 1cf1071aefd04dbf8b0177472ccec7f8
I20260808 15:57:13.637935 32354 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cf1071aefd04dbf8b0177472ccec7f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:13 UTC) from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:37454
I20260808 15:57:13.637969 394 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cf1071aefd04dbf8b0177472ccec7f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:13 UTC) from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:37582
I20260808 15:57:13.638002 32604 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cf1071aefd04dbf8b0177472ccec7f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:13 UTC) from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:35810
I20260808 15:57:13.638103 573 tablet_replica.cc:330] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c: stopping tablet replica
I20260808 15:57:13.638171 572 tablet_replica.cc:330] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: stopping tablet replica
I20260808 15:57:13.638211 573 raft_consensus.cc:2229] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:13.638275 572 raft_consensus.cc:2229] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:13.638322 573 raft_consensus.cc:2258] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:13.638373 572 raft_consensus.cc:2258] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:13.638487 571 tablet_replica.cc:330] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85: stopping tablet replica
I20260808 15:57:13.638579 571 raft_consensus.cc:2229] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:57:13.638811 571 raft_consensus.cc:2258] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:13.639436 571 ts_tablet_manager.cc:1905] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:13.639591 572 ts_tablet_manager.cc:1905] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:13.639631 32148 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35174:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:57:13.640008 32148 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:57:13.641189 573 ts_tablet_manager.cc:1905] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:13.642027 572 ts_tablet_manager.cc:1918] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:13.642102 572 log.cc:1196] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/1cf1071aefd04dbf8b0177472ccec7f8
I20260808 15:57:13.642248 571 ts_tablet_manager.cc:1918] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:13.642318 571 log.cc:1196] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/1cf1071aefd04dbf8b0177472ccec7f8
I20260808 15:57:13.642436 572 ts_tablet_manager.cc:1939] T 1cf1071aefd04dbf8b0177472ccec7f8 P ad1162ddbe6f480e8d7c5cc5efe5d26c: Deleting consensus metadata
I20260808 15:57:13.642575 571 ts_tablet_manager.cc:1939] T 1cf1071aefd04dbf8b0177472ccec7f8 P a0b862dff21c4a96858014a1afd77d85: Deleting consensus metadata
I20260808 15:57:13.643100 32129 catalog_manager.cc:4841] TS ad1162ddbe6f480e8d7c5cc5efe5d26c (127.19.93.2:35071): tablet 1cf1071aefd04dbf8b0177472ccec7f8 (table test-table [id=6e3902cd7c3b4fbe83683b6ee8771b23]) successfully deleted
I20260808 15:57:13.643428 573 ts_tablet_manager.cc:1918] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:13.643491 573 log.cc:1196] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-0/wal/wals/1cf1071aefd04dbf8b0177472ccec7f8
I20260808 15:57:13.643646 573 ts_tablet_manager.cc:1939] T 1cf1071aefd04dbf8b0177472ccec7f8 P eef9750d84e74b9b8fded942e7d7c81c: Deleting consensus metadata
I20260808 15:57:13.643924 32129 catalog_manager.cc:4841] TS a0b862dff21c4a96858014a1afd77d85 (127.19.93.3:38959): tablet 1cf1071aefd04dbf8b0177472ccec7f8 (table test-table [id=6e3902cd7c3b4fbe83683b6ee8771b23]) successfully deleted
I20260808 15:57:13.644726 32131 catalog_manager.cc:4841] TS eef9750d84e74b9b8fded942e7d7c81c (127.19.93.1:33705): tablet 1cf1071aefd04dbf8b0177472ccec7f8 (table test-table [id=6e3902cd7c3b4fbe83683b6ee8771b23]) successfully deleted
I20260808 15:57:13.647432 32354 tablet_service.cc:1467] Processing CreateTablet for tablet b1477f7bc8f740809aba591e1120df5f (DEFAULT_TABLE table=test-table [id=5f9cd27db19e48af96f6afa4340d2d51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:13.647696 32354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1477f7bc8f740809aba591e1120df5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:13.647733 32604 tablet_service.cc:1467] Processing CreateTablet for tablet b1477f7bc8f740809aba591e1120df5f (DEFAULT_TABLE table=test-table [id=5f9cd27db19e48af96f6afa4340d2d51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:13.647751 394 tablet_service.cc:1467] Processing CreateTablet for tablet b1477f7bc8f740809aba591e1120df5f (DEFAULT_TABLE table=test-table [id=5f9cd27db19e48af96f6afa4340d2d51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:13.647959 32604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1477f7bc8f740809aba591e1120df5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:13.647967 394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1477f7bc8f740809aba591e1120df5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:13.649806 541 tablet_bootstrap.cc:492] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c: Bootstrap starting.
I20260808 15:57:13.650061 544 tablet_bootstrap.cc:492] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c: Bootstrap starting.
I20260808 15:57:13.650064 542 tablet_bootstrap.cc:492] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85: Bootstrap starting.
I20260808 15:57:13.650602 541 tablet_bootstrap.cc:654] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:13.650827 544 tablet_bootstrap.cc:654] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:13.650926 542 tablet_bootstrap.cc:654] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:13.652195 544 tablet_bootstrap.cc:492] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c: No bootstrap required, opened a new log
I20260808 15:57:13.652272 544 ts_tablet_manager.cc:1397] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:13.652407 541 tablet_bootstrap.cc:492] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c: No bootstrap required, opened a new log
I20260808 15:57:13.652482 541 ts_tablet_manager.cc:1397] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 15:57:13.652684 542 tablet_bootstrap.cc:492] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85: No bootstrap required, opened a new log
I20260808 15:57:13.652650 544 raft_consensus.cc:348] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.652750 544 raft_consensus.cc:374] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:13.652755 542 ts_tablet_manager.cc:1397] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 15:57:13.652778 544 raft_consensus.cc:729] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad1162ddbe6f480e8d7c5cc5efe5d26c, State: Initialized, Role: FOLLOWER
I20260808 15:57:13.652872 541 raft_consensus.cc:348] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.652907 544 consensus_queue.cc:260] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.652980 541 raft_consensus.cc:374] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:13.653010 541 raft_consensus.cc:729] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef9750d84e74b9b8fded942e7d7c81c, State: Initialized, Role: FOLLOWER
I20260808 15:57:13.653156 544 ts_tablet_manager.cc:1428] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:57:13.653119 541 consensus_queue.cc:260] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.653170 542 raft_consensus.cc:348] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.653257 542 raft_consensus.cc:374] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:13.653286 542 raft_consensus.cc:729] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0b862dff21c4a96858014a1afd77d85, State: Initialized, Role: FOLLOWER
I20260808 15:57:13.653362 541 ts_tablet_manager.cc:1428] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 15:57:13.653402 542 consensus_queue.cc:260] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.653650 542 ts_tablet_manager.cc:1428] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 15:57:13.768074 550 raft_consensus.cc:482] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:57:13.768241 550 raft_consensus.cc:504] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.768689 550 leader_election.cc:288] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eef9750d84e74b9b8fded942e7d7c81c (127.19.93.1:33705), a0b862dff21c4a96858014a1afd77d85 (127.19.93.3:38959)
I20260808 15:57:13.769080 32387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1477f7bc8f740809aba591e1120df5f" candidate_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef9750d84e74b9b8fded942e7d7c81c" is_pre_election: true
I20260808 15:57:13.769153 430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1477f7bc8f740809aba591e1120df5f" candidate_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0b862dff21c4a96858014a1afd77d85" is_pre_election: true
I20260808 15:57:13.769217 32387 raft_consensus.cc:2454] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad1162ddbe6f480e8d7c5cc5efe5d26c in term 0.
I20260808 15:57:13.769289 430 raft_consensus.cc:2454] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad1162ddbe6f480e8d7c5cc5efe5d26c in term 0.
I20260808 15:57:13.769595 32522 leader_election.cc:302] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0b862dff21c4a96858014a1afd77d85, ad1162ddbe6f480e8d7c5cc5efe5d26c; no voters:
I20260808 15:57:13.769778 550 raft_consensus.cc:2781] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:57:13.769829 550 raft_consensus.cc:482] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:57:13.769871 550 raft_consensus.cc:3037] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:13.771214 550 raft_consensus.cc:504] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.771589 550 leader_election.cc:288] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [CANDIDATE]: Term 1 election: Requested vote from peers eef9750d84e74b9b8fded942e7d7c81c (127.19.93.1:33705), a0b862dff21c4a96858014a1afd77d85 (127.19.93.3:38959)
I20260808 15:57:13.771965 32387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1477f7bc8f740809aba591e1120df5f" candidate_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef9750d84e74b9b8fded942e7d7c81c"
I20260808 15:57:13.771994 430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1477f7bc8f740809aba591e1120df5f" candidate_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0b862dff21c4a96858014a1afd77d85"
I20260808 15:57:13.772104 430 raft_consensus.cc:3037] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:13.772104 32387 raft_consensus.cc:3037] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:13.773162 430 raft_consensus.cc:2454] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad1162ddbe6f480e8d7c5cc5efe5d26c in term 1.
I20260808 15:57:13.773176 32387 raft_consensus.cc:2454] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad1162ddbe6f480e8d7c5cc5efe5d26c in term 1.
I20260808 15:57:13.773456 32522 leader_election.cc:302] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0b862dff21c4a96858014a1afd77d85, ad1162ddbe6f480e8d7c5cc5efe5d26c; no voters:
I20260808 15:57:13.773643 550 raft_consensus.cc:2781] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:13.773743 550 raft_consensus.cc:686] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 LEADER]: Becoming Leader. State: Replica: ad1162ddbe6f480e8d7c5cc5efe5d26c, State: Running, Role: LEADER
I20260808 15:57:13.773877 550 consensus_queue.cc:237] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } }
I20260808 15:57:13.775539 32145 catalog_manager.cc:5495] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c reported cstate change: term changed from 0 to 1, leader changed from <none> to ad1162ddbe6f480e8d7c5cc5efe5d26c (127.19.93.2). New cstate: current_term: 1 leader_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad1162ddbe6f480e8d7c5cc5efe5d26c" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 35071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 } health_report { overall_health: UNKNOWN } } }
I20260808 15:57:13.811636 540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.808806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35836 (local address 127.19.93.2:35071)
0808 15:57:13.808926 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:13.808930 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:13.808943 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:57:13.809066 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:13.809070 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:13.809112 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:13.809172 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:57:13.809402 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.809909 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.810693 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:13.810911 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:13.810998 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:13.811225 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:57:13.811294 (+ 69us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:57:13.811352 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:13.811459 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 15:57:13.811508 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:57:13.816844 430 raft_consensus.cc:1261] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Refusing update from remote peer ad1162ddbe6f480e8d7c5cc5efe5d26c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:13.816912 32387 raft_consensus.cc:1261] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Refusing update from remote peer ad1162ddbe6f480e8d7c5cc5efe5d26c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:13.817302 615 consensus_queue.cc:1035] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0b862dff21c4a96858014a1afd77d85" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:13.817463 550 consensus_queue.cc:1035] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eef9750d84e74b9b8fded942e7d7c81c" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:13.843556 32146 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:13.843685 32146 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:13.845417 32146 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 70354424f7f14c51a4b2b8781a0cf55e: Sending DeleteTablet for 3 replicas of tablet b1477f7bc8f740809aba591e1120df5f
I20260808 15:57:13.845846 32354 tablet_service.cc:1514] Processing DeleteTablet for tablet b1477f7bc8f740809aba591e1120df5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:13 UTC) from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:37454
I20260808 15:57:13.846017 573 tablet_replica.cc:330] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c: stopping tablet replica
I20260808 15:57:13.845979 32604 tablet_service.cc:1514] Processing DeleteTablet for tablet b1477f7bc8f740809aba591e1120df5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:13 UTC) from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:35810
I20260808 15:57:13.846123 573 raft_consensus.cc:2229] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:13.846217 573 raft_consensus.cc:2258] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:13.846323 394 tablet_service.cc:1514] Processing DeleteTablet for tablet b1477f7bc8f740809aba591e1120df5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:13 UTC) from {username='oryx', principal='oryx/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:37582
I20260808 15:57:13.846359 572 tablet_replica.cc:330] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c: stopping tablet replica
I20260808 15:57:13.846481 572 raft_consensus.cc:2229] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:57:13.846491 571 tablet_replica.cc:330] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85: stopping tablet replica
I20260808 15:57:13.846597 571 raft_consensus.cc:2229] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:13.846644 572 raft_consensus.cc:2258] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:13.846701 571 raft_consensus.cc:2258] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:13.847154 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 32259
I20260808 15:57:13.847357 573 ts_tablet_manager.cc:1905] T b1477f7bc8f740809aba591e1120df5f P eef9750d84e74b9b8fded942e7d7c81c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:13.852893 571 ts_tablet_manager.cc:1905] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:13.855010 571 ts_tablet_manager.cc:1918] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:57:13.855086 571 log.cc:1196] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/b1477f7bc8f740809aba591e1120df5f
I20260808 15:57:13.855278 571 ts_tablet_manager.cc:1939] T b1477f7bc8f740809aba591e1120df5f P a0b862dff21c4a96858014a1afd77d85: Deleting consensus metadata
I20260808 15:57:13.857796 572 ts_tablet_manager.cc:1905] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:13.857792 32129 catalog_manager.cc:4841] TS a0b862dff21c4a96858014a1afd77d85 (127.19.93.3:38959): tablet b1477f7bc8f740809aba591e1120df5f (table test-table [id=5f9cd27db19e48af96f6afa4340d2d51]) successfully deleted
I20260808 15:57:13.859680 572 ts_tablet_manager.cc:1918] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:57:13.859746 572 log.cc:1196] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/b1477f7bc8f740809aba591e1120df5f
I20260808 15:57:13.859913 572 ts_tablet_manager.cc:1939] T b1477f7bc8f740809aba591e1120df5f P ad1162ddbe6f480e8d7c5cc5efe5d26c: Deleting consensus metadata
I20260808 15:57:13.860613 32129 catalog_manager.cc:4841] TS ad1162ddbe6f480e8d7c5cc5efe5d26c (127.19.93.2:35071): tablet b1477f7bc8f740809aba591e1120df5f (table test-table [id=5f9cd27db19e48af96f6afa4340d2d51]) successfully deleted
W20260808 15:57:13.869109 32131 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:33705 (error 108)
I20260808 15:57:13.869280 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 32475
I20260808 15:57:13.876058 664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:13.872178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:33705 (local address 127.0.0.1:37472)
0808 15:57:13.875895 (+ 3717us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:13.875962 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:33705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3644,"thread_start_us":404,"threads_started":1}
W20260808 15:57:13.876264 32131 catalog_manager.cc:4584] TS eef9750d84e74b9b8fded942e7d7c81c (127.19.93.1:33705): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b1477f7bc8f740809aba591e1120df5f: Network error: Client connection negotiation failed: client connection to 127.19.93.1:33705: connect: Connection refused (error 111)
I20260808 15:57:13.883749 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 32743
I20260808 15:57:13.896714 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 32100
2026-08-08T15:57:13Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3078 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:57:13 dist-test-slave-lgr5 krb5kdc[669](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:57:13 dist-test-slave-lgr5 krb5kdc[669](info): set up 2 sockets
Aug 08 15:57:13 dist-test-slave-lgr5 krb5kdc[669](info): commencing operation
krb5kdc: starting...
W20260808 15:57:15.045641 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:57:15 dist-test-slave-lgr5 krb5kdc[669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:57:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:57:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:57:15.163064 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:40947
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:33647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:40947
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:15.286386 690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:15.286624 690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:15.286661 690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:15.290473 690 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:57:15.290516 690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:15.290534 690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:15.290548 690 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:57:15.290561 690 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:57:15.295578 690 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:33647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:40947
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:40947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:15.296495 690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:15.297385 690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:15.305136 700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:15.305143 704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:15.305153 701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:15.305341 690 server_base.cc:1034] running on GCE node
I20260808 15:57:15.305898 690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:15.306880 690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:15.308028 690 hybrid_clock.cc:648] HybridClock initialized: now 1786204635308009 us; error 30 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T15:57:15Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1420 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:57:15 dist-test-slave-lgr5 krb5kdc[714](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:57:15 dist-test-slave-lgr5 krb5kdc[714](info): set up 2 sockets
Aug 08 15:57:15 dist-test-slave-lgr5 krb5kdc[714](info): commencing operation
krb5kdc: starting...
W20260808 15:57:16.461598 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:57:16 dist-test-slave-lgr5 krb5kdc[714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204636, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:57:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:57:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:57:16.575013 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:44911
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:44911
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:16.681499 737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:16.681739 737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:16.681780 737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:16.685662 737 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:57:16.685712 737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:16.685732 737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:16.685762 737 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:57:16.685788 737 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:57:16.690783 737 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:44911
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:44911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.737
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:16.691681 737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:16.692623 737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:16.700636 747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:16.700632 743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:16.700636 745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:16.700837 737 server_base.cc:1034] running on GCE node
I20260808 15:57:16.701496 737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:16.702512 737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:16.703660 737 hybrid_clock.cc:648] HybridClock initialized: now 1786204636703638 us; error 34 us; skew 500 ppm
Aug 08 15:57:16 dist-test-slave-lgr5 krb5kdc[714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204636, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:16.706429 737 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:57:16.707288 737 webserver.cc:460] Webserver started at http://127.19.93.62:44511/ using document root <none> and password file <none>
I20260808 15:57:16.707787 737 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:16.707844 737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:16.708006 737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:16.709951 737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "43a9c950c5a94bdca817bd8115a9d7d0"
format_stamp: "Formatted at 2026-08-08 15:57:16 on dist-test-slave-lgr5"
server_key: "ac6a7df1405b9a1f40b6b32880f06b52"
server_key_iv: "39011c369b3e449ccf9dcb14551ff2cb"
server_key_version: "encryptionkey@0"
I20260808 15:57:16.710450 737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "43a9c950c5a94bdca817bd8115a9d7d0"
format_stamp: "Formatted at 2026-08-08 15:57:16 on dist-test-slave-lgr5"
server_key: "ac6a7df1405b9a1f40b6b32880f06b52"
server_key_iv: "39011c369b3e449ccf9dcb14551ff2cb"
server_key_version: "encryptionkey@0"
I20260808 15:57:16.713918 737 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:57:16.716133 756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:16.717252 737 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:16.717352 737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "43a9c950c5a94bdca817bd8115a9d7d0"
format_stamp: "Formatted at 2026-08-08 15:57:16 on dist-test-slave-lgr5"
server_key: "ac6a7df1405b9a1f40b6b32880f06b52"
server_key_iv: "39011c369b3e449ccf9dcb14551ff2cb"
server_key_version: "encryptionkey@0"
I20260808 15:57:16.717432 737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:16.730909 737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:16.733641 737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:16.733807 737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:16.739954 737 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:44911
I20260808 15:57:16.739967 839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:44911 every 8 connection(s)
I20260808 15:57:16.740810 737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:57:16.743438 840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:16.748646 840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0: Bootstrap starting.
I20260808 15:57:16.750062 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 737
I20260808 15:57:16.750190 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:57:16.750454 19828 external_mini_cluster.cc:1428] Setting key 864057db6a71b0356a9c9902aada4178
I20260808 15:57:16.750979 840 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:16.751793 840 log.cc:824] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:16.753873 840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0: No bootstrap required, opened a new log
I20260808 15:57:16.757802 840 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43a9c950c5a94bdca817bd8115a9d7d0" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44911 } }
I20260808 15:57:16.758085 840 raft_consensus.cc:374] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:16.758141 840 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43a9c950c5a94bdca817bd8115a9d7d0, State: Initialized, Role: FOLLOWER
I20260808 15:57:16.758580 840 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43a9c950c5a94bdca817bd8115a9d7d0" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44911 } }
I20260808 15:57:16.758703 840 raft_consensus.cc:388] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:57:16.758760 840 raft_consensus.cc:482] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:57:16.758852 840 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 0 FOLLOWER]: Advancing to term 1
Aug 08 15:57:16 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204636, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:57:16.759652 840 raft_consensus.cc:504] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43a9c950c5a94bdca817bd8115a9d7d0" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44911 } }
I20260808 15:57:16.759990 840 leader_election.cc:302] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43a9c950c5a94bdca817bd8115a9d7d0; no voters:
I20260808 15:57:16.760311 840 leader_election.cc:288] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:57:16.760390 851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:16.760660 851 raft_consensus.cc:686] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 1 LEADER]: Becoming Leader. State: Replica: 43a9c950c5a94bdca817bd8115a9d7d0, State: Running, Role: LEADER
I20260808 15:57:16.761008 851 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43a9c950c5a94bdca817bd8115a9d7d0" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44911 } }
I20260808 15:57:16.761466 840 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:57:16.762161 851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43a9c950c5a94bdca817bd8115a9d7d0. Latest consensus state: current_term: 1 leader_uuid: "43a9c950c5a94bdca817bd8115a9d7d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43a9c950c5a94bdca817bd8115a9d7d0" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44911 } } }
I20260808 15:57:16.762895 851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:16.762778 852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "43a9c950c5a94bdca817bd8115a9d7d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43a9c950c5a94bdca817bd8115a9d7d0" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44911 } } }
I20260808 15:57:16.763303 852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:16.764806 847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:16.751454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55200 (local address 127.19.93.62:44911)
0808 15:57:16.751883 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:16.751902 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:16.751944 (+ 42us) server_negotiation.cc:407] Connection header received
0808 15:57:16.752669 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:16.752693 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:16.753063 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:16.753392 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:16.754079 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:16.755043 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:16.756282 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:16.756735 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:16.756865 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:16.759482 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:16.759487 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:16.759499 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:16.759524 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:16.761397 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:16.761906 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:16.761913 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:16.761918 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:16.762061 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:16.762406 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:16.762409 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:16.762411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:16.762942 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:16.763676 (+ 734us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:16.763828 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 15:57:16.764119 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":112,"threads_started":1}
W20260808 15:57:16.767776 879 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:57:16.767855 879 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:57:16.767925 874 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:57:16.768649 874 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:57:16.773491 874 catalog_manager.cc:1347] Generated new cluster ID: acb966fd52e44ef8bcf876ce62b0ae76
I20260808 15:57:16.773558 874 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:57:16.805094 874 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:57:16.806217 874 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:57:16.812788 874 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0: Generated new TSK 0
I20260808 15:57:16.813436 874 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 15:57:16.846669 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44911
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:16.953024 889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:16.953241 889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:16.953284 889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:16.957264 889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:16.957311 889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:16.957381 889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:57:16.962427 889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44911
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:16.963328 889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:16.964265 889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:16.973083 896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:16.973075 901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:16.973278 889 server_base.cc:1034] running on GCE node
W20260808 15:57:16.973306 899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:16.973806 889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:16.974368 889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:16.975520 889 hybrid_clock.cc:648] HybridClock initialized: now 1786204636975506 us; error 24 us; skew 500 ppm
Aug 08 15:57:16 dist-test-slave-lgr5 krb5kdc[714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204636, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:16.978149 889 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:57:16.978936 889 webserver.cc:460] Webserver started at http://127.19.93.1:46787/ using document root <none> and password file <none>
I20260808 15:57:16.979437 889 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:16.979496 889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:16.979704 889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:16.981721 889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "253e6b517fb44067968e072f7520068a"
format_stamp: "Formatted at 2026-08-08 15:57:16 on dist-test-slave-lgr5"
server_key: "70b0528f9d7eac07335a29c2a5905eda"
server_key_iv: "38a5cee49ab91388f32ea0ba874a8879"
server_key_version: "encryptionkey@0"
I20260808 15:57:16.982237 889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "253e6b517fb44067968e072f7520068a"
format_stamp: "Formatted at 2026-08-08 15:57:16 on dist-test-slave-lgr5"
server_key: "70b0528f9d7eac07335a29c2a5905eda"
server_key_iv: "38a5cee49ab91388f32ea0ba874a8879"
server_key_version: "encryptionkey@0"
I20260808 15:57:16.985811 889 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260808 15:57:16.988037 910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:16.989173 889 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:16.989267 889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "253e6b517fb44067968e072f7520068a"
format_stamp: "Formatted at 2026-08-08 15:57:16 on dist-test-slave-lgr5"
server_key: "70b0528f9d7eac07335a29c2a5905eda"
server_key_iv: "38a5cee49ab91388f32ea0ba874a8879"
server_key_version: "encryptionkey@0"
I20260808 15:57:16.989346 889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:17.011409 889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:17.014570 889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:17.014729 889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:17.015308 889 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:17.016166 889 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:17.016217 889 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:17.016258 889 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:17.016278 889 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:17.024951 889 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:45201
I20260808 15:57:17.024983 1104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:45201 every 8 connection(s)
I20260808 15:57:17.025799 889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:57:17.032421 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 889
I20260808 15:57:17.032547 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:57:17.032909 19828 external_mini_cluster.cc:1428] Setting key 5a9a78a5b754862d197003e88fba74f0
Aug 08 15:57:17 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204636, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:57:17.039372 847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:17.027526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:40791 (local address 127.19.93.62:44911)
0808 15:57:17.027700 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:17.027704 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:17.028483 (+ 779us) server_negotiation.cc:407] Connection header received
0808 15:57:17.029772 (+ 1289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:17.029775 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:17.029821 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:17.029891 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:17.030976 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.031491 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.032847 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.033109 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.033190 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:17.035637 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:17.035640 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:17.035642 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:17.035667 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:17.037120 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:17.037708 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:17.037711 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:17.037712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:17.037796 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:17.038222 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:17.038225 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:17.038227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:17.038425 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:17.038513 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:17.039101 (+ 588us) server_negotiation.cc:299] Negotiation successful
0808 15:57:17.039214 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 15:57:17.040452 1111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:17.027865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:40791)
0808 15:57:17.028342 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:17.028383 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:17.029589 (+ 1206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:17.030039 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:17.030045 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:17.030407 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:17.030864 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:17.030878 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.031599 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.031602 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:17.032735 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:17.032747 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.033255 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.033260 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:17.033440 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:17.033933 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:17.033952 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:17.035479 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:17.037237 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:17.037244 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:17.037259 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:17.037609 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:17.037887 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:17.037890 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:17.037892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:17.038104 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:17.038530 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:17.038536 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:17.038822 (+ 286us) client_negotiation.cc:769] Sending connection context
0808 15:57:17.039063 (+ 241us) client_negotiation.cc:240] Negotiation successful
0808 15:57:17.039388 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":152,"threads_started":1}
I20260808 15:57:17.041625 1106 heartbeater.cc:347] Connected to a master server at 127.19.93.62:44911
I20260808 15:57:17.041842 1106 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:17.042286 1106 heartbeater.cc:511] Master 127.19.93.62:44911 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
I20260808 15:57:17.043768 780 ts_manager.cc:194] Registered new tserver with Master: 253e6b517fb44067968e072f7520068a (127.19.93.1:45201)
I20260808 15:57:17.044916 780 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:40791
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 15:57:17.058509 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44911
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:17.164363 1116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:17.164593 1116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:17.164631 1116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:17.168458 1116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:17.168505 1116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:17.168556 1116 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:57:17.173471 1116 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44911
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:17.174314 1116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:17.175212 1116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:17.184047 1128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:17.184046 1130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:17.184098 1132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:17.184408 1116 server_base.cc:1034] running on GCE node
I20260808 15:57:17.184813 1116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:17.185400 1116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:17.186559 1116 hybrid_clock.cc:648] HybridClock initialized: now 1786204637186542 us; error 27 us; skew 500 ppm
Aug 08 15:57:17 dist-test-slave-lgr5 krb5kdc[714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204637, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:17.189177 1116 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:57:17.189968 1116 webserver.cc:460] Webserver started at http://127.19.93.2:38981/ using document root <none> and password file <none>
I20260808 15:57:17.190472 1116 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:17.190546 1116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:17.190744 1116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:17.192808 1116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "6af86974db0e4d6e8a709b5e620da156"
format_stamp: "Formatted at 2026-08-08 15:57:17 on dist-test-slave-lgr5"
server_key: "b4e23aa0ca7d482ee09cf4fbbdc0fd87"
server_key_iv: "7593ce04cc4e662b2d57f65f609d4029"
server_key_version: "encryptionkey@0"
I20260808 15:57:17.193410 1116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "6af86974db0e4d6e8a709b5e620da156"
format_stamp: "Formatted at 2026-08-08 15:57:17 on dist-test-slave-lgr5"
server_key: "b4e23aa0ca7d482ee09cf4fbbdc0fd87"
server_key_iv: "7593ce04cc4e662b2d57f65f609d4029"
server_key_version: "encryptionkey@0"
I20260808 15:57:17.196908 1116 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:57:17.199107 1148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:17.200215 1116 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:57:17.200316 1116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "6af86974db0e4d6e8a709b5e620da156"
format_stamp: "Formatted at 2026-08-08 15:57:17 on dist-test-slave-lgr5"
server_key: "b4e23aa0ca7d482ee09cf4fbbdc0fd87"
server_key_iv: "7593ce04cc4e662b2d57f65f609d4029"
server_key_version: "encryptionkey@0"
I20260808 15:57:17.200400 1116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:17.212352 1116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:17.215196 1116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:17.215355 1116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:17.215874 1116 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:17.216655 1116 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:17.216702 1116 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:17.216753 1116 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:17.216780 1116 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:17.225124 1116 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:41851
I20260808 15:57:17.225178 1332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:41851 every 8 connection(s)
I20260808 15:57:17.225927 1116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:57:17.233606 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 1116
I20260808 15:57:17.233747 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:57:17.234035 19828 external_mini_cluster.cc:1428] Setting key 9ec8108ae0576204cab6ded197ead7ad
Aug 08 15:57:17 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204637, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:57:17.238855 847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:17.227593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:46847 (local address 127.19.93.62:44911)
0808 15:57:17.227739 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:17.227744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:17.228644 (+ 900us) server_negotiation.cc:407] Connection header received
0808 15:57:17.229929 (+ 1285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:17.229932 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:17.229976 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:17.230049 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:17.231077 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.231601 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.232698 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.232915 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.232987 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:17.235470 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:17.235474 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:17.235476 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:17.235499 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:17.236888 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:17.237427 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:17.237430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:17.237432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:17.237525 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:17.237819 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:17.237823 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:17.237824 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:17.238036 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:17.238141 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:17.238569 (+ 428us) server_negotiation.cc:299] Negotiation successful
0808 15:57:17.238698 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:57:17.239513 1337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:17.227982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:46847)
0808 15:57:17.228496 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:17.228546 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:17.229759 (+ 1213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:17.230174 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:17.230181 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:17.230511 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:17.230964 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:17.230977 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.231691 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.231694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:17.232605 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:17.232615 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.233057 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.233061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:17.233203 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:17.233800 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:17.233820 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:17.235320 (+ 1500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:17.237001 (+ 1681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:17.237007 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:17.237021 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:17.237333 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:17.237612 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:17.237615 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:17.237616 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:17.237741 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:17.238136 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:17.238140 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:17.238350 (+ 210us) client_negotiation.cc:769] Sending connection context
0808 15:57:17.238498 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 15:57:17.238724 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":126,"threads_started":1}
I20260808 15:57:17.240568 1334 heartbeater.cc:347] Connected to a master server at 127.19.93.62:44911
I20260808 15:57:17.240782 1334 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:17.241219 1334 heartbeater.cc:511] Master 127.19.93.62:44911 requested a full tablet report, sending...
I20260808 15:57:17.242219 780 ts_manager.cc:194] Registered new tserver with Master: 6af86974db0e4d6e8a709b5e620da156 (127.19.93.2:41851)
I20260808 15:57:17.242784 780 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:46847
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 15:57:17.260313 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44911
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:17.369572 1341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:17.369804 1341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:17.369844 1341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:17.373888 1341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:17.373943 1341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:17.374017 1341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:57:17.379074 1341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44911
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:17.380144 1341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:17.381120 1341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:17.390053 1352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:17.390053 1354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:17.390081 1348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:17.390285 1341 server_base.cc:1034] running on GCE node
I20260808 15:57:17.390815 1341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:17.391386 1341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:17.392549 1341 hybrid_clock.cc:648] HybridClock initialized: now 1786204637392530 us; error 27 us; skew 500 ppm
Aug 08 15:57:17 dist-test-slave-lgr5 krb5kdc[714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204637, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:17.395174 1341 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:57:17.396003 1341 webserver.cc:460] Webserver started at http://127.19.93.3:39291/ using document root <none> and password file <none>
I20260808 15:57:17.396579 1341 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:17.396646 1341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:17.396838 1341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:17.398789 1341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "647ead242d3d42539c406dfd1464440a"
format_stamp: "Formatted at 2026-08-08 15:57:17 on dist-test-slave-lgr5"
server_key: "8722620efd6b51f4e638a11954095078"
server_key_iv: "c1f2aaa0c31d48abaab2de639d9a5daf"
server_key_version: "encryptionkey@0"
I20260808 15:57:17.399327 1341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "647ead242d3d42539c406dfd1464440a"
format_stamp: "Formatted at 2026-08-08 15:57:17 on dist-test-slave-lgr5"
server_key: "8722620efd6b51f4e638a11954095078"
server_key_iv: "c1f2aaa0c31d48abaab2de639d9a5daf"
server_key_version: "encryptionkey@0"
I20260808 15:57:17.402810 1341 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 15:57:17.405105 1365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:17.406231 1341 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:57:17.406337 1341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "647ead242d3d42539c406dfd1464440a"
format_stamp: "Formatted at 2026-08-08 15:57:17 on dist-test-slave-lgr5"
server_key: "8722620efd6b51f4e638a11954095078"
server_key_iv: "c1f2aaa0c31d48abaab2de639d9a5daf"
server_key_version: "encryptionkey@0"
I20260808 15:57:17.406430 1341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:17.419600 1341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:17.422499 1341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:17.422664 1341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:17.423204 1341 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:17.423972 1341 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:17.424018 1341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:17.424069 1341 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:17.424120 1341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:17.432552 1341 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:45719
I20260808 15:57:17.432580 1550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:45719 every 8 connection(s)
I20260808 15:57:17.433362 1341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:57:17.436184 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 1341
I20260808 15:57:17.436305 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:57:17.436560 19828 external_mini_cluster.cc:1428] Setting key ad084824d7417bdecc128b337e237a52
Aug 08 15:57:17 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204637, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:57:17.445887 847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:17.435018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:58105 (local address 127.19.93.62:44911)
0808 15:57:17.435315 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:17.435319 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:17.435942 (+ 623us) server_negotiation.cc:407] Connection header received
0808 15:57:17.437241 (+ 1299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:17.437243 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:17.437294 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:17.437368 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:17.438757 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.439282 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.440447 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.440657 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.440729 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:17.442907 (+ 2178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:17.442910 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:17.442912 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:17.442936 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:17.444145 (+ 1209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:17.444636 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:17.444638 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:17.444639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:17.444708 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:17.445034 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:17.445035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:17.445037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:17.445190 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:17.445257 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:17.445687 (+ 430us) server_negotiation.cc:299] Negotiation successful
0808 15:57:17.445775 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 15:57:17.446635 1554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:17.435341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:58105)
0808 15:57:17.435774 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:17.435813 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:17.437044 (+ 1231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:17.437537 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:17.437544 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:17.438007 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:17.438616 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:17.438636 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.439409 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.439412 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:17.440339 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:17.440349 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.440768 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.440771 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:17.440923 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:17.441425 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:17.441440 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:17.442758 (+ 1318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:17.444268 (+ 1510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:17.444272 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:17.444283 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:17.444557 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:17.444810 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:17.444813 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:17.444815 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:17.444957 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:17.445267 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:17.445272 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:17.445490 (+ 218us) client_negotiation.cc:769] Sending connection context
0808 15:57:17.445655 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 15:57:17.445885 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":106,"threads_started":1}
I20260808 15:57:17.447587 1551 heartbeater.cc:347] Connected to a master server at 127.19.93.62:44911
I20260808 15:57:17.447806 1551 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:17.448285 1551 heartbeater.cc:511] Master 127.19.93.62:44911 requested a full tablet report, sending...
I20260808 15:57:17.449301 780 ts_manager.cc:194] Registered new tserver with Master: 647ead242d3d42539c406dfd1464440a (127.19.93.3:45719)
I20260808 15:57:17.449962 780 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:58105
I20260808 15:57:17.450205 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.1.keytab.
Entry for principal oryx/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.1.keytab.
WARNING: no policy specified for oryx/127.19.93.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.93.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.2.keytab.
Entry for principal oryx/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.2.keytab.
WARNING: no policy specified for oryx/127.19.93.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.93.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.3.keytab.
Entry for principal oryx/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.3.keytab.
I20260808 15:57:17.514475 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 889
I20260808 15:57:17.527029 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 1116
I20260808 15:57:17.539870 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 1341
I20260808 15:57:17.550292 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 737
I20260808 15:57:17.561575 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:44911
--webserver_interface=127.19.93.62
--webserver_port=44511
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:44911
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:17.670190 1574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:17.670435 1574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:17.670492 1574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:17.674386 1574 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:57:17.674434 1574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:17.674461 1574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:17.674484 1574 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:57:17.674512 1574 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:57:17.679626 1574 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:44911
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:44911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=44511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:17.680639 1574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:17.681627 1574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:17.689706 1583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:17.689713 1587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:17.689730 1584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:17.689896 1574 server_base.cc:1034] running on GCE node
I20260808 15:57:17.690479 1574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:17.691469 1574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:17.692623 1574 hybrid_clock.cc:648] HybridClock initialized: now 1786204637692599 us; error 39 us; skew 500 ppm
Aug 08 15:57:17 dist-test-slave-lgr5 krb5kdc[714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204637, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:17.695053 1574 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:57:17.695886 1574 webserver.cc:460] Webserver started at http://127.19.93.62:44511/ using document root <none> and password file <none>
I20260808 15:57:17.696440 1574 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:17.696535 1574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:17.700106 1574 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:57:17.702024 1600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:17.703107 1574 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:17.703219 1574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "43a9c950c5a94bdca817bd8115a9d7d0"
format_stamp: "Formatted at 2026-08-08 15:57:16 on dist-test-slave-lgr5"
server_key: "ac6a7df1405b9a1f40b6b32880f06b52"
server_key_iv: "39011c369b3e449ccf9dcb14551ff2cb"
server_key_version: "encryptionkey@0"
I20260808 15:57:17.703720 1574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:17.721153 1574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:17.723652 1574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:17.723809 1574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:17.730360 1574 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:44911
I20260808 15:57:17.730396 1684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:44911 every 8 connection(s)
I20260808 15:57:17.731288 1574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:57:17.735628 1686 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:57:17.737360 1686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0: Bootstrap starting.
I20260808 15:57:17.737454 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 1574
I20260808 15:57:17.738009 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:45201
--local_ip_for_outbound_sockets=127.19.93.1
--tserver_master_addrs=127.19.93.62:44911
--webserver_port=46787
--webserver_interface=127.19.93.1
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.93.1
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:57:17.754040 1686 log.cc:824] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:17.760391 1686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:57:17.760696 1686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0: Bootstrap complete.
I20260808 15:57:17.764616 1686 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43a9c950c5a94bdca817bd8115a9d7d0" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44911 } }
I20260808 15:57:17.764994 1686 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43a9c950c5a94bdca817bd8115a9d7d0, State: Initialized, Role: FOLLOWER
I20260808 15:57:17.765471 1686 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43a9c950c5a94bdca817bd8115a9d7d0" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44911 } }
I20260808 15:57:17.765592 1686 raft_consensus.cc:388] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:57:17.765656 1686 raft_consensus.cc:482] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:57:17.765748 1686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260808 15:57:17.767519 1686 raft_consensus.cc:504] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43a9c950c5a94bdca817bd8115a9d7d0" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44911 } }
I20260808 15:57:17.767817 1686 leader_election.cc:302] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43a9c950c5a94bdca817bd8115a9d7d0; no voters:
I20260808 15:57:17.768131 1686 leader_election.cc:288] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 15:57:17.768216 1692 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 15:57:17.768440 1692 raft_consensus.cc:686] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [term 2 LEADER]: Becoming Leader. State: Replica: 43a9c950c5a94bdca817bd8115a9d7d0, State: Running, Role: LEADER
I20260808 15:57:17.768787 1692 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43a9c950c5a94bdca817bd8115a9d7d0" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44911 } }
I20260808 15:57:17.769222 1686 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:57:17.770119 1695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "43a9c950c5a94bdca817bd8115a9d7d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43a9c950c5a94bdca817bd8115a9d7d0" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44911 } } }
I20260808 15:57:17.770246 1695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:17.770951 1710 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:57:17.771193 1699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43a9c950c5a94bdca817bd8115a9d7d0. Latest consensus state: current_term: 2 leader_uuid: "43a9c950c5a94bdca817bd8115a9d7d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43a9c950c5a94bdca817bd8115a9d7d0" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44911 } } }
I20260808 15:57:17.771620 1699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:17.774104 1710 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:57:17.774727 1710 catalog_manager.cc:1259] Loaded cluster ID: acb966fd52e44ef8bcf876ce62b0ae76
I20260808 15:57:17.774788 1710 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:57:17.777119 1710 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:57:17.777762 1710 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 43a9c950c5a94bdca817bd8115a9d7d0: Loaded TSK: 0
I20260808 15:57:17.779072 1710 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 15:57:17.849196 1689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:17.849434 1689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:17.849475 1689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:17.853358 1689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:17.853405 1689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:17.853466 1689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:57:17.858453 1689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.1.keytab
--principal=oryx/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:45201
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=46787
--tserver_master_addrs=127.19.93.62:44911
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:17.859416 1689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:17.860421 1689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:17.869417 1729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:17.869423 1731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:17.869546 1734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:17.869935 1689 server_base.cc:1034] running on GCE node
I20260808 15:57:17.870328 1689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:17.870920 1689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:17.872123 1689 hybrid_clock.cc:648] HybridClock initialized: now 1786204637872099 us; error 36 us; skew 500 ppm
Aug 08 15:57:17 dist-test-slave-lgr5 krb5kdc[714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204637, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:17.874871 1689 init.cc:377] Logged in from keytab as oryx/127.19.93.1@KRBTEST.COM (short username oryx)
I20260808 15:57:17.875756 1689 webserver.cc:460] Webserver started at http://127.19.93.1:46787/ using document root <none> and password file <none>
I20260808 15:57:17.876322 1689 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:17.876408 1689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:17.880131 1689 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 15:57:17.882097 1750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:17.883306 1689 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:17.883404 1689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "253e6b517fb44067968e072f7520068a"
format_stamp: "Formatted at 2026-08-08 15:57:16 on dist-test-slave-lgr5"
server_key: "70b0528f9d7eac07335a29c2a5905eda"
server_key_iv: "38a5cee49ab91388f32ea0ba874a8879"
server_key_version: "encryptionkey@0"
I20260808 15:57:17.883937 1689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:17.903997 1689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:17.906663 1689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:17.906823 1689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:17.907404 1689 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:17.908243 1689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:17.908291 1689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:17.908337 1689 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:17.908365 1689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:17.916700 1689 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:45201
I20260808 15:57:17.916749 1946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:45201 every 8 connection(s)
I20260808 15:57:17.917634 1689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:57:17.924893 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 1689
I20260808 15:57:17.925381 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:41851
--local_ip_for_outbound_sockets=127.19.93.2
--tserver_master_addrs=127.19.93.62:44911
--webserver_port=38981
--webserver_interface=127.19.93.2
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.93.2
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:57:17 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:17 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:17.930176 1955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:17.919614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:39961)
0808 15:57:17.920100 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:17.920146 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:17.921336 (+ 1190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:17.922407 (+ 1071us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:17.922415 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:17.922792 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:17.923217 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:17.923231 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.924500 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.924503 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:17.925733 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:17.925745 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.926470 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.926474 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:17.926659 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:17.927298 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:17.927315 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:17.929479 (+ 2164us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":112,"threads_started":1}
W20260808 15:57:17.930593 1954 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:17.919525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:39961 (local address 127.19.93.62:44911)
0808 15:57:17.920021 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:17.920039 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:17.920249 (+ 210us) server_negotiation.cc:407] Connection header received
0808 15:57:17.921725 (+ 1476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:17.921735 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:17.922017 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:17.922297 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:17.923386 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.924373 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.925851 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.926312 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.926453 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:17.929752 (+ 3299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:39961: BlockingRecv error: recv got EOF from 127.19.93.1:39961 (error 108)
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":125,"threads_started":1}
W20260808 15:57:17.930716 1947 heartbeater.cc:644] Failed to heartbeat to 127.19.93.62:44911 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.93.62:44911: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Aug 08 15:57:17 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:17 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:17.935510 1955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:17.931107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:50845)
0808 15:57:17.931245 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:17.931258 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:17.931328 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:17.931528 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:17.931530 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:17.931667 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:17.931747 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:17.931752 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.932490 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.932493 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:17.933008 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:17.933015 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.933420 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.933423 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:17.933507 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:17.933921 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:17.933931 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:17.935405 (+ 1474us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":84}
W20260808 15:57:17.935802 1954 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:17.931193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:50845 (local address 127.19.93.62:44911)
0808 15:57:17.931307 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:17.931311 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:17.931324 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:57:17.931397 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:17.931400 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:17.931440 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:17.931505 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:17.931849 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.932387 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.933119 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.933328 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.933412 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:17.935549 (+ 2137us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:50845: BlockingRecv error: recv got EOF from 127.19.93.1:50845 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 15:57:17 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:17 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:17.940502 1955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:17.935928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:42699)
0808 15:57:17.936064 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:17.936092 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:17.936159 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:17.936446 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:17.936448 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:17.936559 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:17.936622 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:17.936626 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.937540 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.937542 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:17.938014 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:17.938028 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.938513 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.938515 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:17.938565 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:17.938963 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:17.938973 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:17.940429 (+ 1456us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":77}
W20260808 15:57:17.940668 1954 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:17.936141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:42699 (local address 127.19.93.62:44911)
0808 15:57:17.936263 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:17.936267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:17.936280 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:57:17.936315 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:17.936318 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:17.936358 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:17.936437 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:17.936705 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.937457 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.938105 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:17.938428 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:17.938522 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:17.940570 (+ 2048us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:42699: BlockingRecv error: recv got EOF from 127.19.93.1:42699 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260808 15:57:17.940670 1947 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 15:57:18.036872 1956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:18.037108 1956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:18.037147 1956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:18.041020 1956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:18.041065 1956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:18.041118 1956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:57:18.046036 1956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.2.keytab
--principal=oryx/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:41851
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=38981
--tserver_master_addrs=127.19.93.62:44911
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:18.046926 1956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:18.047860 1956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:18.056783 1961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:18.056849 1956 server_base.cc:1034] running on GCE node
W20260808 15:57:18.056797 1962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:18.056797 1966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:18.057461 1956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:18.058020 1956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:18.059175 1956 hybrid_clock.cc:648] HybridClock initialized: now 1786204638059158 us; error 29 us; skew 500 ppm
Aug 08 15:57:18 dist-test-slave-lgr5 krb5kdc[714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204638, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:18.061719 1956 init.cc:377] Logged in from keytab as oryx/127.19.93.2@KRBTEST.COM (short username oryx)
I20260808 15:57:18.062470 1956 webserver.cc:460] Webserver started at http://127.19.93.2:38981/ using document root <none> and password file <none>
I20260808 15:57:18.062948 1956 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:18.063015 1956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:18.066579 1956 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:18.068523 1979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:18.069631 1956 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:18.069736 1956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "6af86974db0e4d6e8a709b5e620da156"
format_stamp: "Formatted at 2026-08-08 15:57:17 on dist-test-slave-lgr5"
server_key: "b4e23aa0ca7d482ee09cf4fbbdc0fd87"
server_key_iv: "7593ce04cc4e662b2d57f65f609d4029"
server_key_version: "encryptionkey@0"
I20260808 15:57:18.070220 1956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:18.098603 1956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:18.101574 1956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:18.101745 1956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:18.102303 1956 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:18.103183 1956 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:18.103231 1956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:18.103286 1956 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:18.103310 1956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:18.111727 1956 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:41851
I20260808 15:57:18.111779 2165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:41851 every 8 connection(s)
I20260808 15:57:18.112704 1956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
Aug 08 15:57:18 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:18 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:18.121991 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 1956
I20260808 15:57:18.122433 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:45719
--local_ip_for_outbound_sockets=127.19.93.3
--tserver_master_addrs=127.19.93.62:44911
--webserver_port=39291
--webserver_interface=127.19.93.3
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.93.3
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:18.123008 1954 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:18.114440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:36867 (local address 127.19.93.62:44911)
0808 15:57:18.114571 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:18.114574 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:18.115330 (+ 756us) server_negotiation.cc:407] Connection header received
0808 15:57:18.116660 (+ 1330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:18.116664 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:18.116724 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:18.116799 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:18.117877 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.118403 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.119490 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.119716 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.119803 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:18.122884 (+ 3081us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:36867: BlockingRecv error: recv got EOF from 127.19.93.2:36867 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 15:57:18.123535 2171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:18.114743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:36867)
0808 15:57:18.115189 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:18.115230 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:18.116439 (+ 1209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:18.116970 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:18.116977 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:18.117291 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:18.117739 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:18.117753 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.118521 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.118524 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:18.119372 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:18.119382 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.119848 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.119853 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:18.120005 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:18.120557 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:18.120573 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:18.122755 (+ 2182us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":124,"threads_started":1}
W20260808 15:57:18.123953 2169 heartbeater.cc:644] Failed to heartbeat to 127.19.93.62:44911 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.93.62:44911: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Aug 08 15:57:18 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:18 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:18.129057 2171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:18.124364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:35641)
0808 15:57:18.124473 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:18.124488 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:18.124558 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:18.124747 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:18.124748 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:18.124866 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:18.124950 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:18.124954 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.125813 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.125815 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:18.126329 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:18.126335 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.126835 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.126838 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:18.126899 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:18.127294 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:18.127305 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:18.128963 (+ 1658us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 15:57:18.129241 1954 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:18.124439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:35641 (local address 127.19.93.62:44911)
0808 15:57:18.124558 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:18.124563 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:18.124578 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:57:18.124618 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:18.124620 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:18.124660 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:18.124739 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:18.125041 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.125728 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.126435 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.126734 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.126856 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:18.129120 (+ 2264us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:35641: BlockingRecv error: recv got EOF from 127.19.93.2:35641 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 08 15:57:18 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:18 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:18.134038 2171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:18.129769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:42809)
0808 15:57:18.129864 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:18.129878 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:18.129950 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:18.130153 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:18.130156 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:18.130283 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:18.130347 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:18.130351 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.131010 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.131013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:18.131498 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:18.131505 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.131890 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.131893 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:18.131964 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:18.132356 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:18.132367 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:18.133958 (+ 1591us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 15:57:18.134202 1954 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:18.129839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:42809 (local address 127.19.93.62:44911)
0808 15:57:18.129939 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:18.129943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:18.129956 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:57:18.130028 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:18.130031 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:18.130069 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:18.130130 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:18.130446 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.130916 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.131599 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.131798 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.131879 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:18.134098 (+ 2219us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:42809: BlockingRecv error: recv got EOF from 127.19.93.2:42809 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260808 15:57:18.134428 2169 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 15:57:18.231956 2174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:18.232209 2174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:18.232255 2174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:18.236124 2174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:18.236171 2174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:18.236239 2174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:57:18.241194 2174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/krb5kdc/oryx_127.19.93.3.keytab
--principal=oryx/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:45719
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=39291
--tserver_master_addrs=127.19.93.62:44911
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:18.242093 2174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:18.243016 2174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:18.251741 2184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:18.251751 2189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:18.251971 2174 server_base.cc:1034] running on GCE node
W20260808 15:57:18.251751 2185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:18.252486 2174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:18.253069 2174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:18.254261 2174 hybrid_clock.cc:648] HybridClock initialized: now 1786204638254234 us; error 42 us; skew 500 ppm
Aug 08 15:57:18 dist-test-slave-lgr5 krb5kdc[714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204638, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:18.256873 2174 init.cc:377] Logged in from keytab as oryx/127.19.93.3@KRBTEST.COM (short username oryx)
I20260808 15:57:18.257637 2174 webserver.cc:460] Webserver started at http://127.19.93.3:39291/ using document root <none> and password file <none>
I20260808 15:57:18.258124 2174 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:18.258188 2174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:18.261831 2174 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.002s
I20260808 15:57:18.263727 2200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:18.264874 2174 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:18.264966 2174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "647ead242d3d42539c406dfd1464440a"
format_stamp: "Formatted at 2026-08-08 15:57:17 on dist-test-slave-lgr5"
server_key: "8722620efd6b51f4e638a11954095078"
server_key_iv: "c1f2aaa0c31d48abaab2de639d9a5daf"
server_key_version: "encryptionkey@0"
I20260808 15:57:18.265460 2174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:18.277129 2174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:18.279949 2174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:18.280108 2174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:18.280609 2174 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:18.281335 2174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:18.281407 2174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:18.281452 2174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:18.281472 2174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:18.289877 2174 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:45719
I20260808 15:57:18.289908 2390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:45719 every 8 connection(s)
I20260808 15:57:18.290771 2174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:57:18.299363 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 2174
Aug 08 15:57:18 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:18 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 15:57:18.301419 1954 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:18.292433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:49403 (local address 127.19.93.62:44911)
0808 15:57:18.292551 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:18.292555 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:18.293313 (+ 758us) server_negotiation.cc:407] Connection header received
0808 15:57:18.294644 (+ 1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:18.294648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:18.294708 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:18.294779 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:18.295920 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.296475 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.297610 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.297886 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.297981 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:18.301287 (+ 3306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:49403: BlockingRecv error: recv got EOF from 127.19.93.3:49403 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 15:57:18.301855 2393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:18.292727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:49403)
0808 15:57:18.293167 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:18.293208 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:18.294426 (+ 1218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:18.294964 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:18.294972 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:18.295314 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:18.295770 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:18.295783 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.296610 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.296613 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:18.297477 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:18.297488 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.298033 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.298037 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:18.298211 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:18.298672 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:18.298688 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:18.301134 (+ 2446us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":114,"threads_started":1}
W20260808 15:57:18.302301 2391 heartbeater.cc:644] Failed to heartbeat to 127.19.93.62:44911 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.93.62:44911: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Aug 08 15:57:18 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:18 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:18.307849 2393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:18.302714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:60861)
0808 15:57:18.302860 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:18.302871 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:18.302946 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:18.303149 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:18.303152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:18.303305 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:18.303408 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:18.303413 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.304193 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.304196 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:18.305026 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:18.305036 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.305561 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.305565 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:18.305658 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:18.306011 (+ 353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:18.306025 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:18.307719 (+ 1694us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":89}
W20260808 15:57:18.307952 1954 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:18.302812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:60861 (local address 127.19.93.62:44911)
0808 15:57:18.302909 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:18.302912 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:18.302924 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:57:18.303015 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:18.303016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:18.303060 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:18.303122 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:18.303516 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.304065 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.305148 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.305445 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.305551 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:18.307843 (+ 2292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:60861: BlockingRecv error: recv got EOF from 127.19.93.3:60861 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 15:57:18.309288 2402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:18.300319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55204 (local address 127.19.93.62:44911)
0808 15:57:18.300587 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:18.300592 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:18.300606 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:57:18.300643 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:18.300645 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:18.300690 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:18.300791 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:18.301632 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.302216 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.303314 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.303520 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.303607 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:18.305172 (+ 1565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:18.305179 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:18.305197 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:18.305228 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:18.307025 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:18.307439 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:18.307446 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:18.307452 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:18.307576 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:18.308013 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:18.308017 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:18.308019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:18.308473 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:18.308660 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:18.308939 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 15:57:18.309170 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":94,"threads_started":1}
Aug 08 15:57:18 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:18 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:18.312770 2393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:18.308379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:37663)
0808 15:57:18.308466 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:18.308479 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:18.308562 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:18.308756 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:18.308759 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:18.308891 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:18.308955 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:18.308960 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.309731 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.309734 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:18.310352 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:18.310362 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.310751 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.310754 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:18.310834 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:18.311196 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:18.311209 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:18.312691 (+ 1482us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 15:57:18.312873 1954 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:18.308450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:37663 (local address 127.19.93.62:44911)
0808 15:57:18.308584 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:18.308588 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:18.308601 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:57:18.308633 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:18.308636 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:18.308669 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:18.308730 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:18.309062 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.309632 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.310455 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.310650 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.310724 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:18.312796 (+ 2072us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:37663: BlockingRecv error: recv got EOF from 127.19.93.3:37663 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260808 15:57:18.312937 2391 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 15:57:18 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:18 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:18.946635 2403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:18.941274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:33323)
0808 15:57:18.941569 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:18.941583 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:18.941688 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:18.941917 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:18.941919 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:18.942104 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:18.942231 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:18.942238 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.942940 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.942943 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:18.943544 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:18.943553 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.943990 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.943995 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:18.944137 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:18.944702 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:18.944714 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:18.946513 (+ 1799us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":80,"threads_started":1}
W20260808 15:57:18.946810 2406 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:18.941332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:33323 (local address 127.19.93.62:44911)
0808 15:57:18.941581 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:18.941584 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:18.941636 (+ 52us) server_negotiation.cc:407] Connection header received
0808 15:57:18.941770 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:18.941772 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:18.941817 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:18.941889 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:18.942325 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.942842 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.943641 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:18.943869 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:18.943966 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:18.946668 (+ 2702us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:33323: BlockingRecv error: recv got EOF from 127.19.93.1:33323 (error 108)
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":94,"threads_started":1}
Aug 08 15:57:19 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:19 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:19.140432 2409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:19.135054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:52927)
0808 15:57:19.135328 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:19.135358 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:19.135453 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:19.135728 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:19.135731 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:19.135933 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:19.136071 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:19.136111 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:19.137003 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:19.137007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:19.137579 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:19.137587 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:19.137968 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:19.137970 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:19.138026 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:19.138482 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:19.138492 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:19.140312 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":81,"threads_started":1}
W20260808 15:57:19.140561 2406 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:19.135124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:52927 (local address 127.19.93.62:44911)
0808 15:57:19.135346 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:19.135352 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:19.135425 (+ 73us) server_negotiation.cc:407] Connection header received
0808 15:57:19.135543 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:19.135546 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:19.135605 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:19.135687 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:19.136211 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:19.136906 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:19.137676 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:19.137889 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:19.137962 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:19.140454 (+ 2492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:52927: BlockingRecv error: recv got EOF from 127.19.93.2:52927 (error 108)
Metrics: {"server-negotiator.queue_time_us":122}
Aug 08 15:57:19 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:19 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:19.318893 2411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:19.313487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:33753)
0808 15:57:19.313774 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:19.313787 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:19.313896 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:19.314140 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:19.314143 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:19.314336 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:19.314431 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:19.314437 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:19.315186 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:19.315190 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:19.315759 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:19.315767 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:19.316302 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:19.316305 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:19.316394 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:19.316899 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:19.316914 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:19.318759 (+ 1845us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":105,"threads_started":1}
W20260808 15:57:19.318993 2406 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:19.313556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:33753 (local address 127.19.93.62:44911)
0808 15:57:19.313689 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:19.313693 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:19.313857 (+ 164us) server_negotiation.cc:407] Connection header received
0808 15:57:19.313983 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:19.313986 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:19.314033 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:19.314099 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:19.314551 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:19.315081 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:19.315873 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:19.316180 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:19.316270 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:19.318886 (+ 2616us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:33753: BlockingRecv error: recv got EOF from 127.19.93.3:33753 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 15:57:19 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:19 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:19.952221 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:19.947384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:40671)
0808 15:57:19.947685 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:19.947698 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:19.947794 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:19.948012 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:19.948015 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:19.948207 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:19.948306 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:19.948311 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:19.949038 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:19.949040 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:19.949594 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:19.949601 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:19.949950 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:19.949953 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:19.950007 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:19.950443 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:19.950453 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:19.952055 (+ 1602us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":108,"threads_started":1}
W20260808 15:57:19.952355 2415 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:19.947458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:40671 (local address 127.19.93.62:44911)
0808 15:57:19.947699 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:19.947703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:19.947748 (+ 45us) server_negotiation.cc:407] Connection header received
0808 15:57:19.947871 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:19.947873 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:19.947917 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:19.947989 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:19.948408 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:19.948955 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:19.949669 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:19.949876 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:19.949957 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:19.952221 (+ 2264us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:40671: BlockingRecv error: recv got EOF from 127.19.93.1:40671 (error 108)
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":77,"threads_started":1}
Aug 08 15:57:20 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:20 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:20.146025 2416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:20.141136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:58233)
0808 15:57:20.141398 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:20.141411 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:20.141508 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:20.141713 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:20.141715 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:20.141886 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:20.141979 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:20.141984 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:20.142700 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:20.142702 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:20.143264 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:20.143273 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:20.143661 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:20.143663 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:20.143717 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:20.144218 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:20.144230 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:20.145886 (+ 1656us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":91,"threads_started":1}
W20260808 15:57:20.146144 2415 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:20.141217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:58233 (local address 127.19.93.62:44911)
0808 15:57:20.141387 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:20.141393 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:20.141463 (+ 70us) server_negotiation.cc:407] Connection header received
0808 15:57:20.141579 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:20.141581 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:20.141626 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:20.141690 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:20.142064 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:20.142606 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:20.143351 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:20.143582 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:20.143653 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:20.146027 (+ 2374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:58233: BlockingRecv error: recv got EOF from 127.19.93.2:58233 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 08 15:57:20 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:20 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:20.324697 2417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:20.319587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:53419)
0808 15:57:20.319889 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:20.319902 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:20.320000 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:20.320224 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:20.320226 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:20.320404 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:20.320499 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:20.320504 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:20.321196 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:20.321199 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:20.321756 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:20.321764 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:20.322166 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:20.322168 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:20.322225 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:20.322727 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:20.322739 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:20.324560 (+ 1821us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":134,"threads_started":1}
W20260808 15:57:20.324798 2415 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:20.319707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:53419 (local address 127.19.93.62:44911)
0808 15:57:20.319874 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:20.319879 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:20.319969 (+ 90us) server_negotiation.cc:407] Connection header received
0808 15:57:20.320068 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:20.320071 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:20.320135 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:20.320202 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:20.320582 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:20.321100 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:20.321866 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:20.322083 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:20.322158 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:20.324688 (+ 2530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:53419: BlockingRecv error: recv got EOF from 127.19.93.3:53419 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 15:57:20 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:20 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:20.958173 2418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:20.952958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:57023)
0808 15:57:20.953229 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:20.953243 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:20.953339 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:20.953560 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:20.953561 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:20.953739 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:20.953837 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:20.953842 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:20.954615 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:20.954618 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:20.955192 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:20.955200 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:20.955674 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:20.955677 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:20.955735 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:20.956279 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:20.956292 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:20.958056 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":77,"threads_started":1}
W20260808 15:57:20.958326 2419 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:20.953025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:57023 (local address 127.19.93.62:44911)
0808 15:57:20.953292 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:20.953295 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:20.953308 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:57:20.953417 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:20.953419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:20.953462 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:20.953532 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:20.953975 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:20.954527 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:20.955319 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:20.955576 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:20.955660 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:20.958200 (+ 2540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:57023: BlockingRecv error: recv got EOF from 127.19.93.1:57023 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":82,"threads_started":1}
Aug 08 15:57:21 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:21 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:21.156487 2420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:21.146734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:57845)
0808 15:57:21.146988 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:21.147003 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:21.147122 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:21.147334 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:21.147336 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:21.147511 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:21.147604 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:21.147609 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:21.148325 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:21.148328 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:21.148870 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:21.148878 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:21.149244 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:21.149246 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:21.149301 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:21.154489 (+ 5188us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:21.154502 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:21.156344 (+ 1842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":70,"threads_started":1}
W20260808 15:57:21.156615 2419 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:21.146816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:57845 (local address 127.19.93.62:44911)
0808 15:57:21.146967 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:21.146970 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:21.147113 (+ 143us) server_negotiation.cc:407] Connection header received
0808 15:57:21.147202 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:21.147204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:21.147252 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:21.147311 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:21.147696 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:21.148240 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:21.148959 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:21.149166 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:21.149236 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:21.156494 (+ 7258us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:57845: BlockingRecv error: recv got EOF from 127.19.93.2:57845 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 08 15:57:21 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:21 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:21.330350 2421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:21.325411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:41133)
0808 15:57:21.325678 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:21.325691 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:21.325788 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:21.326006 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:21.326008 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:21.326196 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:21.326296 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:21.326301 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:21.326984 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:21.326986 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:21.327536 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:21.327544 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:21.327946 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:21.327948 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:21.328009 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:21.328530 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:21.328544 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:21.330215 (+ 1671us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":89,"threads_started":1}
W20260808 15:57:21.330467 2419 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:21.325486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:41133 (local address 127.19.93.62:44911)
0808 15:57:21.325629 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:21.325633 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:21.325750 (+ 117us) server_negotiation.cc:407] Connection header received
0808 15:57:21.325856 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:21.325858 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:21.325917 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:21.325983 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:21.326378 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:21.326903 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:21.327626 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:21.327849 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:21.327934 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:21.330347 (+ 2413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:41133: BlockingRecv error: recv got EOF from 127.19.93.3:41133 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 15:57:21 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:21 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:21.964207 2423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:21.958936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:38617)
0808 15:57:21.959206 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:21.959219 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:21.959308 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:21.959531 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:21.959533 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:21.959704 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:21.959802 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:21.959807 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:21.960523 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:21.960526 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:21.961200 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:21.961215 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:21.961714 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:21.961718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:21.961802 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:21.962305 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:21.962318 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:21.964051 (+ 1733us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":86,"threads_started":1}
W20260808 15:57:21.964365 2425 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:21.959043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:38617 (local address 127.19.93.62:44911)
0808 15:57:21.959297 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:21.959300 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:21.959313 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:57:21.959383 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:21.959386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:21.959434 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:21.959508 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:21.959900 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:21.960440 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:21.961314 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:21.961606 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:21.961686 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:21.964230 (+ 2544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:38617: BlockingRecv error: recv got EOF from 127.19.93.1:38617 (error 108)
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":100,"threads_started":1}
Aug 08 15:57:22 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:22 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:22.161876 2427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:22.157153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:48027)
0808 15:57:22.157431 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:22.157444 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:22.157543 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:22.157724 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:22.157726 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:22.157910 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:22.158007 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:22.158012 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:22.158658 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:22.158660 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:22.159217 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:22.159224 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:22.159563 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:22.159565 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:22.159622 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:22.160051 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:22.160063 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:22.161765 (+ 1702us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":97,"threads_started":1}
W20260808 15:57:22.162020 2425 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:22.157214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:48027 (local address 127.19.93.62:44911)
0808 15:57:22.157353 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:22.157358 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:22.157506 (+ 148us) server_negotiation.cc:407] Connection header received
0808 15:57:22.157606 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:22.157608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:22.157651 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:22.157713 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:22.158086 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:22.158585 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:22.159294 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:22.159493 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:22.159555 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:22.161907 (+ 2352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:48027: BlockingRecv error: recv got EOF from 127.19.93.2:48027 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 15:57:22 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:22 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:22.336529 2429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:22.331105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:48563)
0808 15:57:22.331440 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:22.331456 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:22.331585 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:22.331850 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:22.331853 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:22.332073 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:22.332246 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:22.332259 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:22.333092 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:22.333096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:22.333656 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:22.333665 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:22.334033 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:22.334035 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:22.334091 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:22.334602 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:22.334616 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:22.336381 (+ 1765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":87,"threads_started":1}
W20260808 15:57:22.336632 2425 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:22.331175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:48563 (local address 127.19.93.62:44911)
0808 15:57:22.331356 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:22.331360 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:22.331539 (+ 179us) server_negotiation.cc:407] Connection header received
0808 15:57:22.331672 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:22.331675 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:22.331729 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:22.331803 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:22.332368 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:22.332985 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:22.333746 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:22.333956 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:22.334025 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:22.336533 (+ 2508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:48563: BlockingRecv error: recv got EOF from 127.19.93.3:48563 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 08 15:57:22 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:22 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:22.970467 2432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:22.964983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:35541)
0808 15:57:22.965263 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:22.965277 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:22.965379 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:22.965656 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:22.965658 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:22.965836 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:22.965956 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:22.965962 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:22.966713 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:22.966716 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:22.967306 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:22.967314 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:22.967703 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:22.967705 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:22.967769 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:22.968261 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:22.968272 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:22.970301 (+ 2029us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":93,"threads_started":1}
W20260808 15:57:22.970571 2433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:22.965045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:35541 (local address 127.19.93.62:44911)
0808 15:57:22.965285 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:22.965288 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:22.965337 (+ 49us) server_negotiation.cc:407] Connection header received
0808 15:57:22.965452 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:22.965454 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:22.965498 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:22.965576 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:22.966058 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:22.966587 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:22.967393 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:22.967606 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:22.967670 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:22.970436 (+ 2766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:35541: BlockingRecv error: recv got EOF from 127.19.93.1:35541 (error 108)
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":83,"threads_started":1}
Aug 08 15:57:23 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:23 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:23.167860 2435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:23.162664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:36847)
0808 15:57:23.162934 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:23.162947 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:23.163040 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:23.163248 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:23.163250 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:23.163455 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:23.163550 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:23.163555 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:23.164277 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:23.164279 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:23.164964 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:23.164976 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:23.165350 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:23.165352 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:23.165430 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:23.165903 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:23.165915 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:23.167704 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":70,"threads_started":1}
W20260808 15:57:23.167948 2433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:23.162831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:36847 (local address 127.19.93.62:44911)
0808 15:57:23.162972 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:23.162976 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:23.162989 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:57:23.163111 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:23.163113 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:23.163155 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:23.163223 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:23.163635 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:23.164205 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:23.165060 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:23.165271 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:23.165361 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:23.167840 (+ 2479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:36847: BlockingRecv error: recv got EOF from 127.19.93.2:36847 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 15:57:23 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:23 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:23.342845 2437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:23.337348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:55221)
0808 15:57:23.337682 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:23.337697 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:23.337815 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:23.338104 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:23.338107 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:23.338325 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:23.338485 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:23.338493 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:23.339282 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:23.339285 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:23.339869 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:23.339878 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:23.340347 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:23.340380 (+ 33us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:23.340479 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:23.340943 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:23.340955 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:23.342728 (+ 1773us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":109,"threads_started":1}
W20260808 15:57:23.342967 2433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:23.337470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:55221 (local address 127.19.93.62:44911)
0808 15:57:23.337636 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:23.337642 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:23.337769 (+ 127us) server_negotiation.cc:407] Connection header received
0808 15:57:23.337917 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:23.337919 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:23.337975 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:23.338060 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:23.338611 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:23.339184 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:23.339958 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:23.340235 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:23.340336 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:23.342851 (+ 2515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:55221: BlockingRecv error: recv got EOF from 127.19.93.3:55221 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 08 15:57:23 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:23 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:23.977979 2438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:23.971245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:53851)
0808 15:57:23.971591 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:23.971609 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:23.971736 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:23.972040 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:23.972043 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:23.972291 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:23.972435 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:23.972444 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:23.973463 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:23.973468 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:23.974423 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:23.974437 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:23.975025 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:23.975029 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:23.975131 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:23.975641 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:23.975656 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:23.977821 (+ 2165us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":85,"threads_started":1}
W20260808 15:57:23.978073 2439 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:23.971327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:53851 (local address 127.19.93.62:44911)
0808 15:57:23.971591 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:23.971596 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:23.971684 (+ 88us) server_negotiation.cc:407] Connection header received
0808 15:57:23.971826 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:23.971829 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:23.971880 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:23.972003 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:23.972552 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:23.973350 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:23.974543 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:23.974904 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:23.975003 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:23.977948 (+ 2945us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:53851: BlockingRecv error: recv got EOF from 127.19.93.1:53851 (error 108)
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":83,"threads_started":1}
Aug 08 15:57:24 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:24 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:24.173941 2440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:24.168529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:51351)
0808 15:57:24.168819 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:24.168832 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:24.168926 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:24.169129 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:24.169132 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:24.169351 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:24.169459 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:24.169468 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:24.170493 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:24.170496 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:24.171127 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:24.171137 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:24.171533 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:24.171535 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:24.171593 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:24.172113 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:24.172129 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:24.173826 (+ 1697us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":101,"threads_started":1}
W20260808 15:57:24.174064 2439 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:24.168606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:51351 (local address 127.19.93.62:44911)
0808 15:57:24.168718 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:24.168721 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:24.168891 (+ 170us) server_negotiation.cc:407] Connection header received
0808 15:57:24.168992 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:24.168994 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:24.169040 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:24.169104 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:24.169608 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:24.170370 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:24.171222 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:24.171450 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:24.171525 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:24.173952 (+ 2427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:51351: BlockingRecv error: recv got EOF from 127.19.93.2:51351 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 08 15:57:24 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:24 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:24.348547 2442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:24.343547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:44325)
0808 15:57:24.343831 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:24.343844 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:24.343946 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:24.344174 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:24.344176 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:24.344357 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:24.344451 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:24.344456 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:24.345118 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:24.345120 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:24.345654 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:24.345661 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:24.346003 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:24.346005 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:24.346079 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:24.346567 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:24.346580 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:24.348404 (+ 1824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":77,"threads_started":1}
W20260808 15:57:24.348662 2439 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:24.343627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:44325 (local address 127.19.93.62:44911)
0808 15:57:24.343762 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:24.343768 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:24.343908 (+ 140us) server_negotiation.cc:407] Connection header received
0808 15:57:24.344019 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:24.344021 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:24.344066 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:24.344148 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:24.344535 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:24.345043 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:24.345727 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:24.345931 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:24.345995 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:24.348547 (+ 2552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:44325: BlockingRecv error: recv got EOF from 127.19.93.3:44325 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 08 15:57:24 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:24 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:24.984163 2443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:24.978784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:41991)
0808 15:57:24.979240 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:24.979253 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:24.979367 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:24.979663 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:24.979666 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:24.979879 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:24.979982 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:24.979989 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:24.980754 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:24.980757 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:24.981327 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:24.981336 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:24.981733 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:24.981735 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:24.981792 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:24.982282 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:24.982294 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:24.984007 (+ 1713us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":89,"threads_started":1}
W20260808 15:57:24.984279 2444 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:24.978863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:41991 (local address 127.19.93.62:44911)
0808 15:57:24.979145 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:24.979149 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:24.979327 (+ 178us) server_negotiation.cc:407] Connection header received
0808 15:57:24.979472 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:24.979475 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:24.979532 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:24.979611 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:24.980100 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:24.980653 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:24.981431 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:24.981654 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:24.981723 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:24.984165 (+ 2442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:41991: BlockingRecv error: recv got EOF from 127.19.93.1:41991 (error 108)
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":85,"threads_started":1}
Aug 08 15:57:25 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:25 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:25.179498 2445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:25.174580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:57869)
0808 15:57:25.174916 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:25.174930 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:25.175029 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:25.175246 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:25.175248 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:25.175436 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:25.175537 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:25.175542 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:25.176231 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:25.176234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:25.176799 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:25.176806 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:25.177168 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:25.177171 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:25.177228 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:25.177684 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:25.177695 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:25.179385 (+ 1690us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":99,"threads_started":1}
W20260808 15:57:25.179630 2444 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:25.174653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:57869 (local address 127.19.93.62:44911)
0808 15:57:25.174790 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:25.174793 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:25.174988 (+ 195us) server_negotiation.cc:407] Connection header received
0808 15:57:25.175113 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:25.175116 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:25.175159 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:25.175224 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:25.175618 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:25.176152 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:25.176883 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:25.177089 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:25.177153 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:25.179511 (+ 2358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:57869: BlockingRecv error: recv got EOF from 127.19.93.2:57869 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 08 15:57:25 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:25 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:25.354449 2448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:25.349258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:46287)
0808 15:57:25.349565 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:25.349579 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:25.349680 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:25.349886 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:25.349888 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:25.350064 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:25.350163 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:25.350168 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:25.350837 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:25.350839 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:25.351402 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:25.351409 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:25.351761 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:25.351764 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:25.351820 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:25.352366 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:25.352400 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:25.354332 (+ 1932us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":75,"threads_started":1}
W20260808 15:57:25.354568 2444 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:25.349328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:46287 (local address 127.19.93.62:44911)
0808 15:57:25.349485 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:25.349490 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:25.349640 (+ 150us) server_negotiation.cc:407] Connection header received
0808 15:57:25.349748 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:25.349750 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:25.349795 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:25.349859 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:25.350242 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:25.350760 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:25.351481 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:25.351689 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:25.351753 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:25.354458 (+ 2705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:46287: BlockingRecv error: recv got EOF from 127.19.93.3:46287 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 15:57:25 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:25 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:25.989976 2450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:25.984856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:45297)
0808 15:57:25.985127 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:25.985140 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:25.985230 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:25.985452 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:25.985454 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:25.985629 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:25.985726 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:25.985732 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:25.986509 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:25.986512 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:25.987069 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:25.987078 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:25.987594 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:25.987597 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:25.987666 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:25.988156 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:25.988167 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:25.989856 (+ 1689us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":88,"threads_started":1}
W20260808 15:57:25.990108 2454 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:25.985008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:45297 (local address 127.19.93.62:44911)
0808 15:57:25.985211 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:25.985214 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:25.985228 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:57:25.985302 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:25.985303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:25.985347 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:25.985428 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:25.985852 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:25.986405 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:25.987204 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:25.987492 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:25.987575 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:25.989990 (+ 2415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:45297: BlockingRecv error: recv got EOF from 127.19.93.1:45297 (error 108)
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":64,"threads_started":1}
Aug 08 15:57:26 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:26 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:26.188449 2455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:26.180244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:58631)
0808 15:57:26.180524 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:26.180538 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:26.180651 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:26.180899 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:26.180902 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:26.181093 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:26.181187 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:26.181192 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:26.182067 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:26.182071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:26.182616 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:26.182624 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:26.183049 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:26.183053 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:26.183136 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:26.186541 (+ 3405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:26.186555 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:26.188337 (+ 1782us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":82,"threads_started":1}
W20260808 15:57:26.188604 2454 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:26.180309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:58631 (local address 127.19.93.62:44911)
0808 15:57:26.180496 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:26.180501 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:26.180604 (+ 103us) server_negotiation.cc:407] Connection header received
0808 15:57:26.180735 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:26.180738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:26.180785 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:26.180848 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:26.181297 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:26.181965 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:26.182724 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:26.182950 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:26.183035 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:26.188481 (+ 5446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:58631: BlockingRecv error: recv got EOF from 127.19.93.2:58631 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 15:57:26 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:26 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:26.360226 2456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:26.355141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:43645)
0808 15:57:26.355436 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:26.355449 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:26.355559 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:26.355796 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:26.355799 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:26.356017 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:26.356143 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:26.356150 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:26.356883 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:26.356895 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:26.357447 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:26.357455 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:26.357878 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:26.357881 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:26.357974 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:26.358432 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:26.358444 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:26.360058 (+ 1614us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":108,"threads_started":1}
W20260808 15:57:26.360332 2454 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:26.355218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:43645 (local address 127.19.93.62:44911)
0808 15:57:26.355365 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:26.355369 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:26.355516 (+ 147us) server_negotiation.cc:407] Connection header received
0808 15:57:26.355644 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:26.355647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:26.355696 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:26.355759 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:26.356253 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:26.356779 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:26.357557 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:26.357777 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:26.357862 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:26.360232 (+ 2370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:43645: BlockingRecv error: recv got EOF from 127.19.93.3:43645 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 15:57:26 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:26 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:26.995608 2460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:26.990732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:34179)
0808 15:57:26.991004 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:26.991018 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:26.991116 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:26.991328 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:26.991331 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:26.991514 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:26.991619 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:26.991625 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:26.992332 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:26.992335 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:26.992902 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:26.992910 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:26.993282 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:26.993284 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:26.993341 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:26.993796 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:26.993807 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:26.995486 (+ 1679us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":84,"threads_started":1}
W20260808 15:57:26.995754 2462 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:26.990771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:34179 (local address 127.19.93.62:44911)
0808 15:57:26.991018 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:26.991022 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:26.991068 (+ 46us) server_negotiation.cc:407] Connection header received
0808 15:57:26.991186 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:26.991188 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:26.991232 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:26.991304 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:26.991705 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:26.992254 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:26.992985 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:26.993206 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:26.993273 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:26.995620 (+ 2347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:34179: BlockingRecv error: recv got EOF from 127.19.93.1:34179 (error 108)
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":75,"threads_started":1}
Aug 08 15:57:27 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:27 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:27.194550 2463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:27.189192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:36861)
0808 15:57:27.189497 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:27.189512 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:27.189626 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:27.189862 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:27.189865 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:27.190072 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:27.190169 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:27.190176 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:27.190912 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:27.190916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:27.191478 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:27.191486 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:27.191916 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:27.191919 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:27.192001 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:27.192487 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:27.192499 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:27.194437 (+ 1938us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":87,"threads_started":1}
W20260808 15:57:27.194691 2462 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:27.189299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:36861 (local address 127.19.93.62:44911)
0808 15:57:27.189480 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:27.189485 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:27.189581 (+ 96us) server_negotiation.cc:407] Connection header received
0808 15:57:27.189714 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:27.189717 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:27.189763 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:27.189826 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:27.190281 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:27.190804 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:27.191589 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:27.191811 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:27.191902 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:27.194570 (+ 2668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:36861: BlockingRecv error: recv got EOF from 127.19.93.2:36861 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 08 15:57:27 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:27 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:27.366235 2464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:27.361015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:58053)
0808 15:57:27.361287 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:27.361303 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:27.361425 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:27.361712 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:27.361716 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:27.361934 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:27.362066 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:27.362075 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:27.362856 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:27.362859 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:27.363414 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:27.363423 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:27.363784 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:27.363787 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:27.363852 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:27.364356 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:27.364368 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:27.366117 (+ 1749us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":89,"threads_started":1}
W20260808 15:57:27.366353 2462 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:27.361100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:58053 (local address 127.19.93.62:44911)
0808 15:57:27.361232 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:27.361244 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:27.361370 (+ 126us) server_negotiation.cc:407] Connection header received
0808 15:57:27.361516 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:27.361519 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:27.361577 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:27.361663 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:27.362188 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:27.362756 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:27.363502 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:27.363707 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:27.363773 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:27.366249 (+ 2476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:58053: BlockingRecv error: recv got EOF from 127.19.93.3:58053 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 08 15:57:27 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:27 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:28.001304 2465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:27.996329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:38811)
0808 15:57:27.996604 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:27.996618 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:27.996714 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:27.996924 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:27.996926 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:27.997116 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:27.997217 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:27.997222 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:27.997921 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:27.997923 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:27.998482 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:27.998489 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:27.998857 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:27.998860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:27.998921 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:27.999373 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:27.999385 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:28.001150 (+ 1765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":77,"threads_started":1}
W20260808 15:57:28.001453 2467 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:27.996382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:38811 (local address 127.19.93.62:44911)
0808 15:57:27.996621 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:27.996625 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:27.996666 (+ 41us) server_negotiation.cc:407] Connection header received
0808 15:57:27.996784 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:27.996785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:27.996826 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:27.996912 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:27.997300 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:27.997831 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:27.998562 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:27.998767 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:27.998831 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:28.001308 (+ 2477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:38811: BlockingRecv error: recv got EOF from 127.19.93.1:38811 (error 108)
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":77,"threads_started":1}
Aug 08 15:57:28 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:28 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:28.200383 2470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:28.195283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:47405)
0808 15:57:28.195575 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:28.195591 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:28.195702 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:28.195970 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:28.195973 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:28.196176 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:28.196276 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:28.196281 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:28.196971 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:28.196973 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:28.197536 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:28.197543 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:28.197926 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:28.197929 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:28.197984 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:28.198487 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:28.198499 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:28.200264 (+ 1765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":90,"threads_started":1}
W20260808 15:57:28.200516 2467 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:28.195382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:47405 (local address 127.19.93.62:44911)
0808 15:57:28.195560 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:28.195566 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:28.195695 (+ 129us) server_negotiation.cc:407] Connection header received
0808 15:57:28.195776 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:28.195778 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:28.195827 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:28.195905 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:28.196373 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:28.196888 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:28.197628 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:28.197840 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:28.197920 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:28.200404 (+ 2484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:47405: BlockingRecv error: recv got EOF from 127.19.93.2:47405 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 08 15:57:28 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:28 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:28.372471 2477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:28.367063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:53575)
0808 15:57:28.367461 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:28.367482 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:28.367612 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:28.367858 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:28.367860 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:28.368036 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:28.368162 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:28.368167 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:28.368945 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:28.368949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:28.369549 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:28.369560 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:28.370048 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:28.370051 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:28.370122 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:28.370572 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:28.370587 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:28.372356 (+ 1769us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":93,"threads_started":1}
W20260808 15:57:28.372589 2467 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:28.367202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:53575 (local address 127.19.93.62:44911)
0808 15:57:28.367335 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:28.367340 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:28.367579 (+ 239us) server_negotiation.cc:407] Connection header received
0808 15:57:28.367706 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:28.367710 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:28.367762 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:28.367831 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:28.368241 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:28.368825 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:28.369669 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:28.369949 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:28.370043 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:28.372484 (+ 2441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:53575: BlockingRecv error: recv got EOF from 127.19.93.3:53575 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 15:57:29 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:29 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:29.007548 2478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:29.002129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:33143)
0808 15:57:29.002393 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:29.002406 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:29.002508 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:29.002770 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:29.002773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:29.003001 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:29.003128 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:29.003135 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:29.003936 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:29.003939 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:29.004585 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:29.004596 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:29.005014 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:29.005017 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:29.005082 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:29.005603 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:29.005615 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:29.007374 (+ 1759us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":72,"threads_started":1}
W20260808 15:57:29.007651 2479 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:29.002196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:33143 (local address 127.19.93.62:44911)
0808 15:57:29.002421 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:29.002425 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:29.002457 (+ 32us) server_negotiation.cc:407] Connection header received
0808 15:57:29.002577 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:29.002579 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:29.002621 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:29.002696 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:29.003281 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:29.003828 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:29.004691 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:29.004919 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:29.004997 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:29.007521 (+ 2524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:33143: BlockingRecv error: recv got EOF from 127.19.93.1:33143 (error 108)
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":71,"threads_started":1}
Aug 08 15:57:29 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:29 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:29.206702 2481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:29.201124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:36809)
0808 15:57:29.201402 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:29.201416 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:29.201521 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:29.201723 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:29.201725 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:29.201904 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:29.202001 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:29.202006 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:29.202871 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:29.202875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:29.203648 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:29.203662 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:29.204123 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:29.204128 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:29.204200 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:29.204785 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:29.204797 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:29.206502 (+ 1705us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":79,"threads_started":1}
W20260808 15:57:29.206728 2479 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:29.201214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:36809 (local address 127.19.93.62:44911)
0808 15:57:29.201354 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:29.201358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:29.201470 (+ 112us) server_negotiation.cc:407] Connection header received
0808 15:57:29.201596 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:29.201598 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:29.201641 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:29.201698 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:29.202084 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:29.202729 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:29.203770 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:29.203998 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:29.204096 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:29.206630 (+ 2534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:36809: BlockingRecv error: recv got EOF from 127.19.93.2:36809 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 15:57:29 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:29 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:29.378391 2483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:29.373187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:38619)
0808 15:57:29.373426 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:29.373439 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:29.373546 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:29.373786 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:29.373789 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:29.373990 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:29.374101 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:29.374109 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:29.374903 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:29.374907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:29.375468 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:29.375478 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:29.375916 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:29.375920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:29.376004 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:29.376529 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:29.376542 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:29.378229 (+ 1687us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":73,"threads_started":1}
W20260808 15:57:29.378482 2479 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:29.373218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:38619 (local address 127.19.93.62:44911)
0808 15:57:29.373343 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:29.373347 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:29.373503 (+ 156us) server_negotiation.cc:407] Connection header received
0808 15:57:29.373641 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:29.373644 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:29.373692 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:29.373752 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:29.374217 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:29.374771 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:29.375583 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:29.375806 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:29.375899 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:29.378369 (+ 2470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:38619: BlockingRecv error: recv got EOF from 127.19.93.3:38619 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 15:57:30 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:30 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:30.013168 2484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:30.008310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:37159)
0808 15:57:30.008573 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:30.008587 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:30.008684 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:30.008902 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:30.008904 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:30.009081 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:30.009179 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:30.009184 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:30.009905 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:30.009907 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:30.010449 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:30.010455 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:30.010877 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:30.010879 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:30.010936 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:30.011388 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:30.011399 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:30.013051 (+ 1652us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":70,"threads_started":1}
W20260808 15:57:30.013296 2488 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:30.008375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:37159 (local address 127.19.93.62:44911)
0808 15:57:30.008596 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:30.008599 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:30.008636 (+ 37us) server_negotiation.cc:407] Connection header received
0808 15:57:30.008756 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:30.008758 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:30.008801 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:30.008879 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:30.009261 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:30.009821 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:30.010555 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:30.010789 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:30.010871 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:30.013180 (+ 2309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:37159: BlockingRecv error: recv got EOF from 127.19.93.1:37159 (error 108)
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":71,"threads_started":1}
Aug 08 15:57:30 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:30 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:30.212637 2489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:30.207417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:44921)
0808 15:57:30.207691 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:30.207706 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:30.207822 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:30.208064 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:30.208067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:30.208289 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:30.208395 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:30.208401 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:30.209125 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:30.209129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:30.209683 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:30.209693 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:30.210141 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:30.210145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:30.210231 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:30.210718 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:30.210730 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:30.212488 (+ 1758us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":84,"threads_started":1}
W20260808 15:57:30.212718 2488 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:30.207481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:44921 (local address 127.19.93.62:44911)
0808 15:57:30.207657 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:30.207662 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:30.207772 (+ 110us) server_negotiation.cc:407] Connection header received
0808 15:57:30.207918 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:30.207921 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:30.207966 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:30.208028 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:30.208500 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:30.209021 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:30.209809 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:30.210039 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:30.210124 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:30.212620 (+ 2496us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:44921: BlockingRecv error: recv got EOF from 127.19.93.2:44921 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 08 15:57:30 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:30 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:30.384799 2490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:30.379180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:57625)
0808 15:57:30.379485 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:30.379499 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:30.379621 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:30.379882 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:30.379885 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:30.380126 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:30.380231 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:30.380238 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:30.381028 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:30.381033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:30.381598 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:30.381607 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:30.382082 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:30.382086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:30.382174 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:30.382710 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:30.382723 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:30.384636 (+ 1913us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":104,"threads_started":1}
W20260808 15:57:30.384914 2488 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:30.379274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:57625 (local address 127.19.93.62:44911)
0808 15:57:30.379413 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:30.379419 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:30.379573 (+ 154us) server_negotiation.cc:407] Connection header received
0808 15:57:30.379713 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:30.379717 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:30.379771 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:30.379860 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:30.380357 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:30.380901 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:30.381719 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:30.381962 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:30.382067 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:30.384789 (+ 2722us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:57625: BlockingRecv error: recv got EOF from 127.19.93.3:57625 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 15:57:31 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:31 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:31.019179 2492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:31.013949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:33843)
0808 15:57:31.014229 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:31.014242 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:31.014348 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:31.014612 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:31.014615 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:31.014825 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:31.014927 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:31.014935 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:31.015826 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:31.015831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:31.016453 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:31.016464 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:31.016888 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:31.016890 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:31.016948 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:31.017407 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:31.017418 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:31.019055 (+ 1637us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":93,"threads_started":1}
W20260808 15:57:31.019289 2494 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:31.014000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:33843 (local address 127.19.93.62:44911)
0808 15:57:31.014240 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:31.014244 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:31.014306 (+ 62us) server_negotiation.cc:407] Connection header received
0808 15:57:31.014441 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:31.014443 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:31.014488 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:31.014567 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:31.015039 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:31.015713 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:31.016552 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:31.016786 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:31.016860 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:31.019175 (+ 2315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:33843: BlockingRecv error: recv got EOF from 127.19.93.1:33843 (error 108)
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":55,"threads_started":1}
Aug 08 15:57:31 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:31 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:31.222385 2495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:31.213508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:50537)
0808 15:57:31.213774 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:31.213787 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:31.213876 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:31.214109 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:31.214111 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:31.214287 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:31.214405 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:31.214410 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:31.215167 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:31.215170 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:31.215739 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:31.215748 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:31.216236 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:31.216239 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:31.216307 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:31.220543 (+ 4236us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:31.220556 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:31.222246 (+ 1690us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":78,"threads_started":1}
W20260808 15:57:31.222487 2494 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:31.213638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:50537 (local address 127.19.93.62:44911)
0808 15:57:31.213836 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:31.213841 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:31.213857 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:57:31.213961 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:31.213963 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:31.214010 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:31.214086 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:31.214511 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:31.215052 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:31.215865 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:31.216121 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:31.216230 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:31.222378 (+ 6148us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:50537: BlockingRecv error: recv got EOF from 127.19.93.2:50537 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 08 15:57:31 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:31 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:31.391122 2497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:31.385556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:48407)
0808 15:57:31.385803 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:31.385816 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:31.385927 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:31.386146 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:31.386148 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:31.386319 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:31.386421 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:31.386428 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:31.387108 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:31.387110 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:31.387903 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:31.387918 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:31.388487 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:31.388491 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:31.388583 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:31.389158 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:31.389176 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:31.390989 (+ 1813us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":84,"threads_started":1}
W20260808 15:57:31.391233 2494 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:31.385616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:48407 (local address 127.19.93.62:44911)
0808 15:57:31.385780 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:31.385784 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:31.385887 (+ 103us) server_negotiation.cc:407] Connection header received
0808 15:57:31.385994 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:31.385996 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:31.386057 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:31.386122 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:31.386504 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:31.387007 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:31.388061 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:31.388338 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:31.388438 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:31.391121 (+ 2683us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:48407: BlockingRecv error: recv got EOF from 127.19.93.3:48407 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 08 15:57:32 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:32 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:32.024956 2498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:32.019860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:55849)
0808 15:57:32.020199 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:32.020214 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:32.020305 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:32.020516 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:32.020518 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:32.020702 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:32.020799 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:32.020804 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:32.021490 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:32.021493 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:32.022043 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:32.022050 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:32.022431 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:32.022434 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:32.022493 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:32.022948 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:32.022960 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:32.024789 (+ 1829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":99,"threads_started":1}
W20260808 15:57:32.025049 2499 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:32.019932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:55849 (local address 127.19.93.62:44911)
0808 15:57:32.020251 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:32.020255 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:32.020268 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:57:32.020381 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:32.020384 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:32.020428 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:32.020492 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:32.020880 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:32.021414 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:32.022121 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:32.022331 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:32.022408 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:32.024931 (+ 2523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:55849: BlockingRecv error: recv got EOF from 127.19.93.1:55849 (error 108)
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":111,"threads_started":1}
Aug 08 15:57:32 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:32 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:32.228399 2500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:32.223112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:40303)
0808 15:57:32.223393 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:32.223406 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:32.223510 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:32.223726 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:32.223728 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:32.223911 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:32.224025 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:32.224031 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:32.224778 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:32.224780 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:32.225441 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:32.225452 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:32.225863 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:32.225865 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:32.225921 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:32.226435 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:32.226447 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:32.228236 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":99,"threads_started":1}
W20260808 15:57:32.228456 2499 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:32.223161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:40303 (local address 127.19.93.62:44911)
0808 15:57:32.223307 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:32.223311 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:32.223501 (+ 190us) server_negotiation.cc:407] Connection header received
0808 15:57:32.223578 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:32.223580 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:32.223630 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:32.223702 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:32.224147 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:32.224700 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:32.225560 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:32.225782 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:32.225855 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:32.228360 (+ 2505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:40303: BlockingRecv error: recv got EOF from 127.19.93.2:40303 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 15:57:32 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:32 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.3@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:32.396854 2503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:32.391793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.3:54279)
0808 15:57:32.392126 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:32.392139 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:32.392238 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:32.392443 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:32.392445 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:32.392626 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:32.392726 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:32.392731 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:32.393411 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:32.393413 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:32.393980 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:32.393987 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:32.394349 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:32.394351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:32.394410 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:32.394856 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:32.394868 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:32.396694 (+ 1826us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":82,"threads_started":1}
W20260808 15:57:32.396942 2499 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:32.391840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:54279 (local address 127.19.93.62:44911)
0808 15:57:32.391974 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:32.391979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:32.392203 (+ 224us) server_negotiation.cc:407] Connection header received
0808 15:57:32.392301 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:32.392303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:32.392351 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:32.392419 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:32.392813 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:32.393334 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:32.394068 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:32.394274 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:32.394338 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:32.396828 (+ 2490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.3:54279: BlockingRecv error: recv got EOF from 127.19.93.3:54279 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 08 15:57:33 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:33 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.1@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:33.031157 2506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:33.025937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.1:56593)
0808 15:57:33.026201 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:33.026214 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:33.026301 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:33.026588 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:33.026591 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:33.026777 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:33.026877 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:33.026899 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:33.027602 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:33.027604 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:33.028190 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:33.028198 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:33.028634 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:33.028637 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:33.028693 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:33.029197 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:33.029210 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:33.031038 (+ 1828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":86,"threads_started":1}
W20260808 15:57:33.031333 2511 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:33.026043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:56593 (local address 127.19.93.62:44911)
0808 15:57:33.026300 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:33.026304 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:33.026322 (+ 18us) server_negotiation.cc:407] Connection header received
0808 15:57:33.026408 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:33.026412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:33.026461 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:33.026546 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:33.026988 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:33.027519 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:33.028294 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:33.028538 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:33.028634 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:33.031201 (+ 2567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.1:56593: BlockingRecv error: recv got EOF from 127.19.93.1:56593 (error 108)
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":77,"threads_started":1}
Aug 08 15:57:33 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:57:33 dist-test-slave-lgr5 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.93.2@KRBTEST.COM for oryx/127.19.93.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:57:33.234320 2512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:33.229229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44911 (local address 127.19.93.2:42265)
0808 15:57:33.229539 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:33.229551 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:33.229642 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:33.229844 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:33.229846 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:33.230029 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:33.230126 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:33.230131 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:33.230840 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:33.230844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:33.231419 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:33.231428 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:33.231825 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:33.231828 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:33.231903 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:33.232363 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:33.232375 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:33.234204 (+ 1829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.93.62:44911: Server oryx/127.19.93.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":84,"threads_started":1}
W20260808 15:57:33.234465 2511 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:33.229319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:42265 (local address 127.19.93.62:44911)
0808 15:57:33.229451 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:33.229454 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:33.229608 (+ 154us) server_negotiation.cc:407] Connection header received
0808 15:57:33.229711 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:33.229713 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:33.229756 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:33.229819 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:33.230207 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:33.230719 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:33.231515 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:33.231721 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:33.231786 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:33.234344 (+ 2558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.93.2:42265: BlockingRecv error: recv got EOF from 127.19.93.2:42265 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 15:57:33.304996 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 1689
I20260808 15:57:33.325387 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 1956
I20260808 15:57:33.336462 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 2174
I20260808 15:57:33.346753 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 1574
2026-08-08T15:57:33Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18031 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T15:57:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:57:33Z Disabled control of system clock
I20260808 15:57:33.381618 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:46557
--webserver_interface=127.19.93.62
--webserver_port=0
--builtin_ntp_servers=127.19.93.20:32943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:46557
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 15:57:33.490515 2519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:33.490753 2519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:33.490783 2519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:33.494686 2519 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:57:33.494745 2519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:33.494760 2519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:33.494774 2519 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:57:33.494788 2519 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:57:33.499431 2519 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:32943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:46557
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:46557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:33.500419 2519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:33.501746 2519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:33.509900 2527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:33.509990 2524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:33.509955 2519 server_base.cc:1034] running on GCE node
W20260808 15:57:33.509979 2525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:33.510644 2519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:33.511626 2519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:33.512779 2519 hybrid_clock.cc:648] HybridClock initialized: now 1786204653512765 us; error 25 us; skew 500 ppm
I20260808 15:57:33.514452 2519 webserver.cc:460] Webserver started at http://127.19.93.62:43019/ using document root <none> and password file <none>
I20260808 15:57:33.514983 2519 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:33.515048 2519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:33.515239 2519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:33.517309 2519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "5988a438293e4d95b81cf61d9170efb1"
format_stamp: "Formatted at 2026-08-08 15:57:33 on dist-test-slave-lgr5"
server_key: "ee1ee48ea1cfacd33c575da1d28a6c38"
server_key_iv: "b55893464dcdbb165e9d452e2ff5e50b"
server_key_version: "encryptionkey@0"
I20260808 15:57:33.517885 2519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "5988a438293e4d95b81cf61d9170efb1"
format_stamp: "Formatted at 2026-08-08 15:57:33 on dist-test-slave-lgr5"
server_key: "ee1ee48ea1cfacd33c575da1d28a6c38"
server_key_iv: "b55893464dcdbb165e9d452e2ff5e50b"
server_key_version: "encryptionkey@0"
I20260808 15:57:33.521281 2519 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:57:33.523499 2536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:33.524649 2519 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:33.524758 2519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "5988a438293e4d95b81cf61d9170efb1"
format_stamp: "Formatted at 2026-08-08 15:57:33 on dist-test-slave-lgr5"
server_key: "ee1ee48ea1cfacd33c575da1d28a6c38"
server_key_iv: "b55893464dcdbb165e9d452e2ff5e50b"
server_key_version: "encryptionkey@0"
I20260808 15:57:33.524863 2519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:33.551409 2519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:33.552033 2519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:33.552218 2519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:33.558583 2519 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:46557
I20260808 15:57:33.558597 2628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:46557 every 8 connection(s)
I20260808 15:57:33.559496 2519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:57:33.562507 2629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:33.567181 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 2519
I20260808 15:57:33.567293 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:57:33.567570 19828 external_mini_cluster.cc:1428] Setting key c434cea48be586f9167d778bf8a04612
I20260808 15:57:33.567865 2629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1: Bootstrap starting.
I20260808 15:57:33.570809 2629 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:33.571525 2629 log.cc:824] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:33.573567 2629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1: No bootstrap required, opened a new log
I20260808 15:57:33.576395 2634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:33.568795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57878 (local address 127.19.93.62:46557)
0808 15:57:33.569349 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:33.569366 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:33.569401 (+ 35us) server_negotiation.cc:407] Connection header received
0808 15:57:33.570024 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:33.570039 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:33.570395 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:33.570681 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:33.571104 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:33.572106 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:33.573284 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:33.573790 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:33.573949 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:33.574738 (+ 789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:33.574743 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:33.574755 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:33.575128 (+ 373us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:33.575181 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:33.575200 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:33.575282 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:33.575432 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 15:57:33.575671 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":105,"threads_started":1}
I20260808 15:57:33.577183 2629 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5988a438293e4d95b81cf61d9170efb1" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46557 } }
I20260808 15:57:33.577435 2629 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:33.577491 2629 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5988a438293e4d95b81cf61d9170efb1, State: Initialized, Role: FOLLOWER
I20260808 15:57:33.577940 2629 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5988a438293e4d95b81cf61d9170efb1" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46557 } }
I20260808 15:57:33.578106 2629 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:57:33.578171 2629 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:57:33.578262 2629 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:33.579177 2629 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5988a438293e4d95b81cf61d9170efb1" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46557 } }
I20260808 15:57:33.579464 2629 leader_election.cc:302] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5988a438293e4d95b81cf61d9170efb1; no voters:
I20260808 15:57:33.579715 2629 leader_election.cc:288] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:57:33.579813 2638 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:33.580098 2638 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [term 1 LEADER]: Becoming Leader. State: Replica: 5988a438293e4d95b81cf61d9170efb1, State: Running, Role: LEADER
I20260808 15:57:33.580400 2638 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5988a438293e4d95b81cf61d9170efb1" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46557 } }
I20260808 15:57:33.580812 2629 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:57:33.581810 2641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5988a438293e4d95b81cf61d9170efb1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5988a438293e4d95b81cf61d9170efb1" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46557 } } }
I20260808 15:57:33.581943 2641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:33.582257 2646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5988a438293e4d95b81cf61d9170efb1. Latest consensus state: current_term: 1 leader_uuid: "5988a438293e4d95b81cf61d9170efb1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5988a438293e4d95b81cf61d9170efb1" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46557 } } }
I20260808 15:57:33.582322 2660 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:57:33.582347 2646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:33.585323 2660 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:57:33.590216 2660 catalog_manager.cc:1347] Generated new cluster ID: 74e2a1f7dcf841f695c48c571e55a894
I20260808 15:57:33.590276 2660 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:57:33.611569 2660 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:57:33.612558 2660 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:57:33.621336 2660 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5988a438293e4d95b81cf61d9170efb1: Generated new TSK 0
I20260808 15:57:33.621950 2660 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:57:33.630923 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:46557
--builtin_ntp_servers=127.19.93.20:32943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 15:57:33.767843 2680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:33.768069 2680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:33.768132 2680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:33.771981 2680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:33.772025 2680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:33.772112 2680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:57:33.776671 2680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:32943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:46557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:33.777638 2680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:33.778899 2680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:33.787958 2690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:33.787935 2686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:33.787954 2688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:33.788275 2680 server_base.cc:1034] running on GCE node
I20260808 15:57:33.788693 2680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:33.789269 2680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:33.790438 2680 hybrid_clock.cc:648] HybridClock initialized: now 1786204653790421 us; error 28 us; skew 500 ppm
I20260808 15:57:33.792127 2680 webserver.cc:460] Webserver started at http://127.19.93.1:45451/ using document root <none> and password file <none>
I20260808 15:57:33.792644 2680 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:33.792709 2680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:33.792902 2680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:33.794791 2680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "06e0ff1a696f4d63adad44edf26413eb"
format_stamp: "Formatted at 2026-08-08 15:57:33 on dist-test-slave-lgr5"
server_key: "fc94589a86ce1156999a0d2bcbe140d8"
server_key_iv: "37f58c72b43537beb08ec8f1883beec7"
server_key_version: "encryptionkey@0"
I20260808 15:57:33.795302 2680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "06e0ff1a696f4d63adad44edf26413eb"
format_stamp: "Formatted at 2026-08-08 15:57:33 on dist-test-slave-lgr5"
server_key: "fc94589a86ce1156999a0d2bcbe140d8"
server_key_iv: "37f58c72b43537beb08ec8f1883beec7"
server_key_version: "encryptionkey@0"
I20260808 15:57:33.798631 2680 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 15:57:33.800864 2704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:33.801954 2680 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:57:33.802057 2680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "06e0ff1a696f4d63adad44edf26413eb"
format_stamp: "Formatted at 2026-08-08 15:57:33 on dist-test-slave-lgr5"
server_key: "fc94589a86ce1156999a0d2bcbe140d8"
server_key_iv: "37f58c72b43537beb08ec8f1883beec7"
server_key_version: "encryptionkey@0"
I20260808 15:57:33.802145 2680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:33.827613 2680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:33.828390 2680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:33.828559 2680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:33.829103 2680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:33.830005 2680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:33.830052 2680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:33.830106 2680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:33.830134 2680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:33.838083 2680 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:46063
I20260808 15:57:33.838121 2890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:46063 every 8 connection(s)
I20260808 15:57:33.838919 2680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:57:33.847479 2634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:33.840625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:35497 (local address 127.19.93.62:46557)
0808 15:57:33.840748 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:33.840751 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:33.841720 (+ 969us) server_negotiation.cc:407] Connection header received
0808 15:57:33.843070 (+ 1350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:33.843074 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:33.843137 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:33.843209 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:33.844104 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:33.844643 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:33.845759 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:33.845978 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:33.846068 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:33.847030 (+ 962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:33.847033 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:33.847035 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:33.847049 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:33.847069 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:33.847076 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:33.847136 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:33.847274 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 15:57:33.847336 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 15:57:33.848297 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 2680
I20260808 15:57:33.848410 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:57:33.848438 2897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:33.840958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46557 (local address 127.19.93.1:35497)
0808 15:57:33.841571 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:33.841611 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:33.842854 (+ 1243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:33.843390 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:33.843396 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:33.843475 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:33.843931 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:33.843943 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:33.844771 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:33.844774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:33.845638 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:33.845647 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:33.846130 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:33.846135 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:33.846287 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:33.846791 (+ 504us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:57:33.846793 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:33.846830 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:57:33.846890 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:33.847147 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:33.847157 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:33.847163 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:57:33.847264 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 15:57:33.847521 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":106,"threads_started":1}
I20260808 15:57:33.848747 19828 external_mini_cluster.cc:1428] Setting key d6be72b0ace43b7cb3b02701e1cb6af2
I20260808 15:57:33.849607 2891 heartbeater.cc:347] Connected to a master server at 127.19.93.62:46557
I20260808 15:57:33.849807 2891 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:33.850356 2891 heartbeater.cc:511] Master 127.19.93.62:46557 requested a full tablet report, sending...
I20260808 15:57:33.850726 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:46557
--builtin_ntp_servers=127.19.93.20:32943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 15:57:33.851920 2566 ts_manager.cc:194] Registered new tserver with Master: 06e0ff1a696f4d63adad44edf26413eb (127.19.93.1:46063)
I20260808 15:57:33.853422 2566 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.93.1:35497
W20260808 15:57:33.957718 2898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:33.957955 2898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:33.957990 2898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:33.961790 2898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:33.961838 2898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:33.961886 2898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:57:33.966341 2898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:32943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:46557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:33.967260 2898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:33.968528 2898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:33.978822 2913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:33.978885 2908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:33.978952 2898 server_base.cc:1034] running on GCE node
W20260808 15:57:33.978811 2911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:33.979636 2898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:33.980273 2898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:33.981437 2898 hybrid_clock.cc:648] HybridClock initialized: now 1786204653981414 us; error 31 us; skew 500 ppm
I20260808 15:57:33.983178 2898 webserver.cc:460] Webserver started at http://127.19.93.2:46455/ using document root <none> and password file <none>
I20260808 15:57:33.983700 2898 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:33.983755 2898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:33.983917 2898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:33.985939 2898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "a31aa9af16564980bb60cb33604dedab"
format_stamp: "Formatted at 2026-08-08 15:57:33 on dist-test-slave-lgr5"
server_key: "1ff8d6f331e1069d18e58abe3660585b"
server_key_iv: "25e99e3a262a4a3923e759b26fab1ed5"
server_key_version: "encryptionkey@0"
I20260808 15:57:33.986440 2898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "a31aa9af16564980bb60cb33604dedab"
format_stamp: "Formatted at 2026-08-08 15:57:33 on dist-test-slave-lgr5"
server_key: "1ff8d6f331e1069d18e58abe3660585b"
server_key_iv: "25e99e3a262a4a3923e759b26fab1ed5"
server_key_version: "encryptionkey@0"
I20260808 15:57:33.990097 2898 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:57:33.992545 2929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:33.993692 2898 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:57:33.993798 2898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "a31aa9af16564980bb60cb33604dedab"
format_stamp: "Formatted at 2026-08-08 15:57:33 on dist-test-slave-lgr5"
server_key: "1ff8d6f331e1069d18e58abe3660585b"
server_key_iv: "25e99e3a262a4a3923e759b26fab1ed5"
server_key_version: "encryptionkey@0"
I20260808 15:57:33.993892 2898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:34.008463 2898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:34.009083 2898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:34.009248 2898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:34.009802 2898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:34.010710 2898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:34.010757 2898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:34.010810 2898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:34.010838 2898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:34.019083 2898 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:42185
I20260808 15:57:34.019136 3115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:42185 every 8 connection(s)
I20260808 15:57:34.019922 2898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:57:34.027166 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 2898
I20260808 15:57:34.027256 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:57:34.027560 19828 external_mini_cluster.cc:1428] Setting key 35d2fcd91bcb2cb732cfa0941c4a7271
I20260808 15:57:34.028556 2634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:34.021589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:52841 (local address 127.19.93.62:46557)
0808 15:57:34.021747 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:34.021752 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:34.022761 (+ 1009us) server_negotiation.cc:407] Connection header received
0808 15:57:34.024045 (+ 1284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:34.024049 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:34.024122 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:34.024194 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:34.024999 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:34.025503 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:34.026595 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:34.026797 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:34.026860 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:34.027941 (+ 1081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:34.027944 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:34.027946 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:34.027958 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:34.027981 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:34.027992 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:34.028063 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:34.028340 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 15:57:34.028405 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 15:57:34.029486 3123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:34.021990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46557 (local address 127.19.93.2:52841)
0808 15:57:34.022629 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:34.022668 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:34.023859 (+ 1191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:34.024342 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:34.024349 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:34.024435 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:34.024886 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:34.024897 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:34.025602 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:34.025605 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:34.026496 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:34.026506 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:34.026914 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:34.026917 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:34.027056 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:34.027663 (+ 607us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:57:34.027665 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:34.027729 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:57:34.027799 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:34.028098 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:34.028107 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:34.028113 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:57:34.028277 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 15:57:34.028562 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":109,"threads_started":1}
I20260808 15:57:34.029603 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:46557
--builtin_ntp_servers=127.19.93.20:32943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 15:57:34.030536 3116 heartbeater.cc:347] Connected to a master server at 127.19.93.62:46557
I20260808 15:57:34.030751 3116 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:34.031242 3116 heartbeater.cc:511] Master 127.19.93.62:46557 requested a full tablet report, sending...
I20260808 15:57:34.032323 2566 ts_manager.cc:194] Registered new tserver with Master: a31aa9af16564980bb60cb33604dedab (127.19.93.2:42185)
I20260808 15:57:34.032891 2566 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.93.2:52841
W20260808 15:57:34.138916 3126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:34.139150 3126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:34.139185 3126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:34.143162 3126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:34.143209 3126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:34.143261 3126 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:57:34.147827 3126 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:32943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:46557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:34.148806 3126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:34.150092 3126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:34.159235 3134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:34.159240 3135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:34.159293 3126 server_base.cc:1034] running on GCE node
W20260808 15:57:34.159253 3138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:34.159790 3126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:34.160410 3126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:34.161556 3126 hybrid_clock.cc:648] HybridClock initialized: now 1786204654161538 us; error 29 us; skew 500 ppm
I20260808 15:57:34.163265 3126 webserver.cc:460] Webserver started at http://127.19.93.3:42279/ using document root <none> and password file <none>
I20260808 15:57:34.163820 3126 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:34.163882 3126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:34.164100 3126 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:34.166071 3126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "165301b98e9d41ad830850c76355c4cb"
format_stamp: "Formatted at 2026-08-08 15:57:34 on dist-test-slave-lgr5"
server_key: "2a6b76f82c2619a1ba798165449de84c"
server_key_iv: "0bf2aab7be8676ef543aba9996af91de"
server_key_version: "encryptionkey@0"
I20260808 15:57:34.166574 3126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "165301b98e9d41ad830850c76355c4cb"
format_stamp: "Formatted at 2026-08-08 15:57:34 on dist-test-slave-lgr5"
server_key: "2a6b76f82c2619a1ba798165449de84c"
server_key_iv: "0bf2aab7be8676ef543aba9996af91de"
server_key_version: "encryptionkey@0"
I20260808 15:57:34.169966 3126 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:57:34.172214 3148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:34.173290 3126 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:57:34.173400 3126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "165301b98e9d41ad830850c76355c4cb"
format_stamp: "Formatted at 2026-08-08 15:57:34 on dist-test-slave-lgr5"
server_key: "2a6b76f82c2619a1ba798165449de84c"
server_key_iv: "0bf2aab7be8676ef543aba9996af91de"
server_key_version: "encryptionkey@0"
I20260808 15:57:34.173487 3126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:34.189023 3126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:34.189669 3126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:34.189824 3126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:34.190373 3126 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:34.191278 3126 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:34.191325 3126 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:34.191387 3126 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:34.191411 3126 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:34.199960 3126 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:44311
I20260808 15:57:34.200001 3337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:44311 every 8 connection(s)
I20260808 15:57:34.200863 3126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:57:34.206457 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 3126
I20260808 15:57:34.206544 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:57:34.206794 19828 external_mini_cluster.cc:1428] Setting key 00415cd2060c338b9053ab4f6eb7c266
I20260808 15:57:34.210232 2634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:34.202605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:47029 (local address 127.19.93.62:46557)
0808 15:57:34.202763 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:34.202768 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:34.203800 (+ 1032us) server_negotiation.cc:407] Connection header received
0808 15:57:34.205304 (+ 1504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:34.205308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:34.205364 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:34.205437 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:34.206278 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:34.206889 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:34.208363 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:34.208681 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:34.208798 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:34.209840 (+ 1042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:34.209843 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:34.209845 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:34.209858 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:34.209880 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:34.209889 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:34.209956 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:34.210066 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 15:57:34.210116 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 15:57:34.210991 3342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:34.203004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46557 (local address 127.19.93.3:47029)
0808 15:57:34.203654 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:34.203693 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:34.205076 (+ 1383us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:34.205576 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:34.205582 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:34.205660 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:34.206142 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:34.206161 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:34.207011 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:34.207014 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:34.208245 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:34.208254 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:34.208823 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:34.208826 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:34.209006 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:34.209573 (+ 567us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:57:34.209574 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:34.209618 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:57:34.209678 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:34.209963 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:34.209968 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:34.209971 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 15:57:34.210055 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 15:57:34.210257 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":114,"threads_started":1}
I20260808 15:57:34.211958 3338 heartbeater.cc:347] Connected to a master server at 127.19.93.62:46557
I20260808 15:57:34.212194 3338 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:34.212677 3338 heartbeater.cc:511] Master 127.19.93.62:46557 requested a full tablet report, sending...
I20260808 15:57:34.213590 2566 ts_manager.cc:194] Registered new tserver with Master: 165301b98e9d41ad830850c76355c4cb (127.19.93.3:44311)
I20260808 15:57:34.214108 2566 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.93.3:47029
I20260808 15:57:34.220254 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 15:57:34.222867 2634 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:34.222031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57890 (local address 127.19.93.62:46557)
0808 15:57:34.222136 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:34.222140 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:34.222315 (+ 175us) server_negotiation.cc:407] Connection header received
0808 15:57:34.222431 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:34.222434 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:34.222471 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:34.222528 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:34.222778 (+ 250us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57890: BlockingRecv error: recv got EOF from 127.0.0.1:57890 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 15:57:34.223063 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 2680
I20260808 15:57:34.241142 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 2898
I20260808 15:57:34.249764 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 3126
I20260808 15:57:34.264046 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 2519
2026-08-08T15:57:34Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (913 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T15:57:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:57:34Z Disabled control of system clock
I20260808 15:57:34.295156 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:42261
--webserver_interface=127.19.93.62
--webserver_port=0
--builtin_ntp_servers=127.19.93.20:36681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:42261
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 15:57:34.402807 3358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:34.403028 3358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:34.403070 3358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:34.406906 3358 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:57:34.406952 3358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:34.406966 3358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:34.406991 3358 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:57:34.407018 3358 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:57:34.411563 3358 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:42261
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:42261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:34.412482 3358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:34.413720 3358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:34.421555 3373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:34.421576 3367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:34.421556 3368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:34.421721 3358 server_base.cc:1034] running on GCE node
I20260808 15:57:34.422302 3358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:34.423245 3358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:34.424393 3358 hybrid_clock.cc:648] HybridClock initialized: now 1786204654424371 us; error 39 us; skew 500 ppm
I20260808 15:57:34.426076 3358 webserver.cc:460] Webserver started at http://127.19.93.62:37235/ using document root <none> and password file <none>
I20260808 15:57:34.426584 3358 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:34.426645 3358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:34.426832 3358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:34.428761 3358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "ea1dfa930c7e4fc79162206ad3f6c570"
format_stamp: "Formatted at 2026-08-08 15:57:34 on dist-test-slave-lgr5"
server_key: "c835b1e4ba9703674f874224232b08e6"
server_key_iv: "85586b0b872a6dd1ba959766a8eb2bfc"
server_key_version: "encryptionkey@0"
I20260808 15:57:34.429313 3358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "ea1dfa930c7e4fc79162206ad3f6c570"
format_stamp: "Formatted at 2026-08-08 15:57:34 on dist-test-slave-lgr5"
server_key: "c835b1e4ba9703674f874224232b08e6"
server_key_iv: "85586b0b872a6dd1ba959766a8eb2bfc"
server_key_version: "encryptionkey@0"
I20260808 15:57:34.432632 3358 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:57:34.434782 3384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:34.435864 3358 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:34.435973 3358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "ea1dfa930c7e4fc79162206ad3f6c570"
format_stamp: "Formatted at 2026-08-08 15:57:34 on dist-test-slave-lgr5"
server_key: "c835b1e4ba9703674f874224232b08e6"
server_key_iv: "85586b0b872a6dd1ba959766a8eb2bfc"
server_key_version: "encryptionkey@0"
I20260808 15:57:34.436071 3358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:34.440248 3358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:34.440789 3358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:34.440940 3358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:34.447176 3358 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:42261
I20260808 15:57:34.447192 3467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:42261 every 8 connection(s)
I20260808 15:57:34.447993 3358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:57:34.450213 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 3358
I20260808 15:57:34.450314 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:57:34.450579 19828 external_mini_cluster.cc:1428] Setting key e21f9bce90bd294d65ad680e090122cc
I20260808 15:57:34.451138 3468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:34.456185 3471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:34.451886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34330 (local address 127.19.93.62:42261)
0808 15:57:34.452547 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:34.452567 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:34.452608 (+ 41us) server_negotiation.cc:407] Connection header received
0808 15:57:34.453309 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:34.453334 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:34.453749 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:34.454117 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:34.454760 (+ 643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:34.454766 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:34.454780 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:34.454790 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:34.454864 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:34.454889 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:34.455027 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:34.455106 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 15:57:34.455333 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":132,"threads_started":1}
I20260808 15:57:34.458002 3468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570: Bootstrap starting.
I20260808 15:57:34.460238 3468 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:34.460901 3468 log.cc:824] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:34.462540 3468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570: No bootstrap required, opened a new log
I20260808 15:57:34.465969 3468 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea1dfa930c7e4fc79162206ad3f6c570" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42261 } }
I20260808 15:57:34.466163 3468 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:34.466202 3468 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1dfa930c7e4fc79162206ad3f6c570, State: Initialized, Role: FOLLOWER
I20260808 15:57:34.466568 3468 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea1dfa930c7e4fc79162206ad3f6c570" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42261 } }
I20260808 15:57:34.466687 3468 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:57:34.466732 3468 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:57:34.466800 3468 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:34.467579 3468 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea1dfa930c7e4fc79162206ad3f6c570" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42261 } }
I20260808 15:57:34.467861 3468 leader_election.cc:302] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea1dfa930c7e4fc79162206ad3f6c570; no voters:
I20260808 15:57:34.468120 3468 leader_election.cc:288] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:57:34.468226 3473 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:34.468436 3473 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [term 1 LEADER]: Becoming Leader. State: Replica: ea1dfa930c7e4fc79162206ad3f6c570, State: Running, Role: LEADER
I20260808 15:57:34.468794 3473 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea1dfa930c7e4fc79162206ad3f6c570" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42261 } }
I20260808 15:57:34.469331 3468 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:57:34.470307 3476 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea1dfa930c7e4fc79162206ad3f6c570" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea1dfa930c7e4fc79162206ad3f6c570" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42261 } } }
I20260808 15:57:34.470436 3476 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:34.470553 3477 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea1dfa930c7e4fc79162206ad3f6c570. Latest consensus state: current_term: 1 leader_uuid: "ea1dfa930c7e4fc79162206ad3f6c570" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea1dfa930c7e4fc79162206ad3f6c570" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42261 } } }
I20260808 15:57:34.470700 3477 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570 [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:34.470995 3491 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:57:34.474073 3491 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:57:34.479504 3491 catalog_manager.cc:1347] Generated new cluster ID: d9a91865564a4e2f870f9f5ef44dd96f
I20260808 15:57:34.479580 3491 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:57:34.498023 3491 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:57:34.498323 3491 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:57:34.507302 3491 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea1dfa930c7e4fc79162206ad3f6c570: Generated new TSK 0
I20260808 15:57:34.507876 3491 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:57:34.520342 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42261
--builtin_ntp_servers=127.19.93.20:36681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 15:57:34.652302 3511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:34.652529 3511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:34.652570 3511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:34.656489 3511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:34.656534 3511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:34.656598 3511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:57:34.661190 3511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:34.662148 3511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:34.663421 3511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:34.672523 3524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:34.672523 3519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:34.672518 3521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:34.672910 3511 server_base.cc:1034] running on GCE node
I20260808 15:57:34.673302 3511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:34.673882 3511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:34.675041 3511 hybrid_clock.cc:648] HybridClock initialized: now 1786204654675021 us; error 30 us; skew 500 ppm
I20260808 15:57:34.676797 3511 webserver.cc:460] Webserver started at http://127.19.93.1:41575/ using document root <none> and password file <none>
I20260808 15:57:34.677321 3511 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:34.677387 3511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:34.677589 3511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:34.679527 3511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "c5b38a168e3548339a3caba50e25e2fd"
format_stamp: "Formatted at 2026-08-08 15:57:34 on dist-test-slave-lgr5"
server_key: "a0eec2f23ca808fef9ab12281eae9b83"
server_key_iv: "8ced90a83456c2a55106c52215322641"
server_key_version: "encryptionkey@0"
I20260808 15:57:34.680107 3511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "c5b38a168e3548339a3caba50e25e2fd"
format_stamp: "Formatted at 2026-08-08 15:57:34 on dist-test-slave-lgr5"
server_key: "a0eec2f23ca808fef9ab12281eae9b83"
server_key_iv: "8ced90a83456c2a55106c52215322641"
server_key_version: "encryptionkey@0"
I20260808 15:57:34.683498 3511 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:57:34.685838 3538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:34.686918 3511 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 15:57:34.687022 3511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "c5b38a168e3548339a3caba50e25e2fd"
format_stamp: "Formatted at 2026-08-08 15:57:34 on dist-test-slave-lgr5"
server_key: "a0eec2f23ca808fef9ab12281eae9b83"
server_key_iv: "8ced90a83456c2a55106c52215322641"
server_key_version: "encryptionkey@0"
I20260808 15:57:34.687114 3511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:34.691293 3511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:34.691835 3511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:34.691982 3511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:34.692508 3511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:34.693352 3511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:34.693398 3511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:34.693447 3511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:34.693475 3511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:34.701215 3511 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:44407
I20260808 15:57:34.701260 3732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:44407 every 8 connection(s)
I20260808 15:57:34.702015 3511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:57:34.707247 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 3511
I20260808 15:57:34.707353 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:57:34.707633 19828 external_mini_cluster.cc:1428] Setting key 8ac4e8d8168222d4d38138023484b1a9
I20260808 15:57:34.707784 3471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:34.703693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:43823 (local address 127.19.93.62:42261)
0808 15:57:34.703821 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:34.703836 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:34.704847 (+ 1011us) server_negotiation.cc:407] Connection header received
0808 15:57:34.706109 (+ 1262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:34.706113 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:34.706160 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:34.706231 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:34.707303 (+ 1072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:34.707307 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:34.707310 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:34.707326 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:34.707350 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:34.707361 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:34.707448 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:34.707605 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 15:57:34.707651 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 15:57:34.708681 3736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:34.704031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42261 (local address 127.19.93.1:43823)
0808 15:57:34.704696 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:34.704735 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:34.705904 (+ 1169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:34.706403 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:34.706409 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:34.706493 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:34.706985 (+ 492us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:57:34.706987 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:34.707040 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:57:34.707127 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:34.707462 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:34.707471 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:34.707477 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:57:34.707636 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 15:57:34.707861 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":110,"threads_started":1}
I20260808 15:57:34.709657 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42261
--builtin_ntp_servers=127.19.93.20:36681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 15:57:34.709856 3733 heartbeater.cc:347] Connected to a master server at 127.19.93.62:42261
I20260808 15:57:34.710049 3733 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:34.710430 3733 heartbeater.cc:511] Master 127.19.93.62:42261 requested a full tablet report, sending...
I20260808 15:57:34.711849 3414 ts_manager.cc:194] Registered new tserver with Master: c5b38a168e3548339a3caba50e25e2fd (127.19.93.1:44407)
W20260808 15:57:34.816691 3737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:34.816924 3737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:34.816960 3737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:34.820806 3737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:34.820850 3737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:34.820901 3737 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:57:34.825392 3737 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3737
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:34.826270 3737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:34.827605 3737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:34.836509 3751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:34.836529 3746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:34.836624 3737 server_base.cc:1034] running on GCE node
W20260808 15:57:34.836589 3744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:34.837133 3737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:34.837700 3737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:34.838863 3737 hybrid_clock.cc:648] HybridClock initialized: now 1786204654838838 us; error 34 us; skew 500 ppm
I20260808 15:57:34.840590 3737 webserver.cc:460] Webserver started at http://127.19.93.2:33227/ using document root <none> and password file <none>
I20260808 15:57:34.841114 3737 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:34.841177 3737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:34.841357 3737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:34.843276 3737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "a5065f07c98a4c2b92bd90e341c99910"
format_stamp: "Formatted at 2026-08-08 15:57:34 on dist-test-slave-lgr5"
server_key: "0f93bf0e30c7e900abc09c88025028fe"
server_key_iv: "7c2e82f54d2f107d6ac4feb18ebea01d"
server_key_version: "encryptionkey@0"
I20260808 15:57:34.843832 3737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "a5065f07c98a4c2b92bd90e341c99910"
format_stamp: "Formatted at 2026-08-08 15:57:34 on dist-test-slave-lgr5"
server_key: "0f93bf0e30c7e900abc09c88025028fe"
server_key_iv: "7c2e82f54d2f107d6ac4feb18ebea01d"
server_key_version: "encryptionkey@0"
I20260808 15:57:34.847240 3737 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 15:57:34.849546 3760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:34.850639 3737 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:57:34.850744 3737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "a5065f07c98a4c2b92bd90e341c99910"
format_stamp: "Formatted at 2026-08-08 15:57:34 on dist-test-slave-lgr5"
server_key: "0f93bf0e30c7e900abc09c88025028fe"
server_key_iv: "7c2e82f54d2f107d6ac4feb18ebea01d"
server_key_version: "encryptionkey@0"
I20260808 15:57:34.850833 3737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:34.855046 3737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:34.855590 3737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:34.855734 3737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:34.856257 3737 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:34.857089 3737 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:34.857134 3737 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:34.857182 3737 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:34.857208 3737 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:34.865139 3737 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:46509
I20260808 15:57:34.865165 3958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:46509 every 8 connection(s)
I20260808 15:57:34.865942 3737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:57:34.866209 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 3737
I20260808 15:57:34.866319 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:57:34.866592 19828 external_mini_cluster.cc:1428] Setting key 25b995241aedc32a81eab6a2287a02d4
I20260808 15:57:34.868618 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42261
--builtin_ntp_servers=127.19.93.20:36681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 15:57:34.871862 3471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:34.867567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:47365 (local address 127.19.93.62:42261)
0808 15:57:34.867678 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:34.867682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:34.868956 (+ 1274us) server_negotiation.cc:407] Connection header received
0808 15:57:34.870248 (+ 1292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:34.870252 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:34.870298 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:34.870384 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:34.871478 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:34.871481 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:34.871483 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:34.871494 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:34.871512 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:34.871520 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:34.871594 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:34.871725 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 15:57:34.871761 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 15:57:34.874099 3962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:34.868059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42261 (local address 127.19.93.2:47365)
0808 15:57:34.868778 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:34.868829 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:34.870039 (+ 1210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:34.870548 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:34.870558 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:34.870663 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:34.871211 (+ 548us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:57:34.871213 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:34.871265 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:57:34.871346 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:34.871600 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:34.871607 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:34.871613 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:57:34.871770 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 15:57:34.871963 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":111,"threads_started":1}
I20260808 15:57:34.875206 3959 heartbeater.cc:347] Connected to a master server at 127.19.93.62:42261
I20260808 15:57:34.875401 3959 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:34.875767 3959 heartbeater.cc:511] Master 127.19.93.62:42261 requested a full tablet report, sending...
I20260808 15:57:34.876775 3414 ts_manager.cc:194] Registered new tserver with Master: a5065f07c98a4c2b92bd90e341c99910 (127.19.93.2:46509)
W20260808 15:57:34.977617 3964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:34.977851 3964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:34.977912 3964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:34.981786 3964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:34.981833 3964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:34.981914 3964 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:57:34.986527 3964 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:36681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:34.987545 3964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:34.988905 3964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:34.998052 3971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:34.998034 3972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:34.998104 3964 server_base.cc:1034] running on GCE node
W20260808 15:57:34.998032 3974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:34.998591 3964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:34.999145 3964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:35.000299 3964 hybrid_clock.cc:648] HybridClock initialized: now 1786204655000285 us; error 23 us; skew 500 ppm
I20260808 15:57:35.001983 3964 webserver.cc:460] Webserver started at http://127.19.93.3:46613/ using document root <none> and password file <none>
I20260808 15:57:35.002497 3964 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:35.002557 3964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:35.002727 3964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:35.004746 3964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "ef560faf3f08420daaae2e7ca63776d2"
format_stamp: "Formatted at 2026-08-08 15:57:34 on dist-test-slave-lgr5"
server_key: "00e39bbb1e4ad3f830606cfa8884dd8d"
server_key_iv: "54f1733786ad66429e39dd63d09c019c"
server_key_version: "encryptionkey@0"
I20260808 15:57:35.005254 3964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "ef560faf3f08420daaae2e7ca63776d2"
format_stamp: "Formatted at 2026-08-08 15:57:34 on dist-test-slave-lgr5"
server_key: "00e39bbb1e4ad3f830606cfa8884dd8d"
server_key_iv: "54f1733786ad66429e39dd63d09c019c"
server_key_version: "encryptionkey@0"
I20260808 15:57:35.008823 3964 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:57:35.011089 3982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:35.012212 3964 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:57:35.012315 3964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "ef560faf3f08420daaae2e7ca63776d2"
format_stamp: "Formatted at 2026-08-08 15:57:34 on dist-test-slave-lgr5"
server_key: "00e39bbb1e4ad3f830606cfa8884dd8d"
server_key_iv: "54f1733786ad66429e39dd63d09c019c"
server_key_version: "encryptionkey@0"
I20260808 15:57:35.012403 3964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:35.016721 3964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:35.017279 3964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:35.017426 3964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:35.017918 3964 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:35.018778 3964 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:35.018824 3964 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:35.018874 3964 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:35.018900 3964 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:35.026888 3964 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:46623
I20260808 15:57:35.026914 4170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:46623 every 8 connection(s)
I20260808 15:57:35.027676 3964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:57:35.033808 3471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:35.029311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:58785 (local address 127.19.93.62:42261)
0808 15:57:35.029442 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:35.029446 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:35.030470 (+ 1024us) server_negotiation.cc:407] Connection header received
0808 15:57:35.031647 (+ 1177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:35.031650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:35.031687 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:35.031765 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:35.033348 (+ 1583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:35.033352 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:35.033355 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:57:35.033368 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:35.033390 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:57:35.033402 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:35.033491 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:35.033628 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 15:57:35.033672 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 15:57:35.034569 4175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:35.029655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42261 (local address 127.19.93.3:58785)
0808 15:57:35.030308 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:35.030346 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:35.031461 (+ 1115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:35.031899 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:35.031905 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:35.031984 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:35.032523 (+ 539us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:57:35.032525 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:35.032590 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:57:35.032677 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:35.033479 (+ 802us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:35.033489 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:35.033495 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:57:35.033659 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 15:57:35.033885 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":104,"threads_started":1}
I20260808 15:57:35.035472 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 3964
I20260808 15:57:35.035561 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:57:35.035624 4172 heartbeater.cc:347] Connected to a master server at 127.19.93.62:42261
I20260808 15:57:35.035842 4172 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:35.035866 19828 external_mini_cluster.cc:1428] Setting key 2ac9b1913460f9d21a4a46d0a2aef7a7
I20260808 15:57:35.036288 4172 heartbeater.cc:511] Master 127.19.93.62:42261 requested a full tablet report, sending...
I20260808 15:57:35.037413 3414 ts_manager.cc:194] Registered new tserver with Master: ef560faf3f08420daaae2e7ca63776d2 (127.19.93.3:46623)
I20260808 15:57:35.049618 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 15:57:35.052271 3471 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:57:35.051439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34344 (local address 127.19.93.62:42261)
0808 15:57:35.051566 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:35.051570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:35.051712 (+ 142us) server_negotiation.cc:407] Connection header received
0808 15:57:35.051811 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:35.051812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:35.051844 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:35.051902 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:35.052150 (+ 248us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34344: BlockingRecv error: recv got EOF from 127.0.0.1:34344 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 15:57:35.052631 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 3511
I20260808 15:57:35.062645 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 3737
I20260808 15:57:35.071530 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 3964
I20260808 15:57:35.086553 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 3358
2026-08-08T15:57:35Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (823 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:57:35 dist-test-slave-lgr5 krb5kdc[4189](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:57:35 dist-test-slave-lgr5 krb5kdc[4189](info): set up 2 sockets
Aug 08 15:57:35 dist-test-slave-lgr5 krb5kdc[4189](info): commencing operation
krb5kdc: starting...
W20260808 15:57:36.258704 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:57:36 dist-test-slave-lgr5 krb5kdc[4189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:57:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:57:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:57:36.377221 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:42803
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:44701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:42803
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:36.484736 4206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:36.484997 4206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:36.485034 4206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:36.488893 4206 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:57:36.488937 4206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:36.488955 4206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:36.488973 4206 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:57:36.488991 4206 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:57:36.494071 4206 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:44701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:42803
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:42803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:36.494999 4206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:36.495944 4206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:36.503901 4217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:36.503923 4206 server_base.cc:1034] running on GCE node
W20260808 15:57:36.503890 4219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:36.503890 4223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:36.504670 4206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:36.505640 4206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:36.506786 4206 hybrid_clock.cc:648] HybridClock initialized: now 1786204656506769 us; error 28 us; skew 500 ppm
Aug 08 15:57:36 dist-test-slave-lgr5 krb5kdc[4189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204656, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:36.512485 4206 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:57:36.513295 4206 webserver.cc:460] Webserver started at http://127.19.93.62:37207/ using document root <none> and password file <none>
I20260808 15:57:36.513784 4206 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:36.513839 4206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:36.514001 4206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:36.515939 4206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "a65251b5d6f241f28db001dc46a7150b"
format_stamp: "Formatted at 2026-08-08 15:57:36 on dist-test-slave-lgr5"
server_key: "9e4ad71bf34809b71fb24ffdf5dc6c53"
server_key_iv: "da18fb94963121e0cbfd157f788c0168"
server_key_version: "encryptionkey@0"
I20260808 15:57:36.516511 4206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "a65251b5d6f241f28db001dc46a7150b"
format_stamp: "Formatted at 2026-08-08 15:57:36 on dist-test-slave-lgr5"
server_key: "9e4ad71bf34809b71fb24ffdf5dc6c53"
server_key_iv: "da18fb94963121e0cbfd157f788c0168"
server_key_version: "encryptionkey@0"
I20260808 15:57:36.519860 4206 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:57:36.522068 4231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:36.523229 4206 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:36.523344 4206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "a65251b5d6f241f28db001dc46a7150b"
format_stamp: "Formatted at 2026-08-08 15:57:36 on dist-test-slave-lgr5"
server_key: "9e4ad71bf34809b71fb24ffdf5dc6c53"
server_key_iv: "da18fb94963121e0cbfd157f788c0168"
server_key_version: "encryptionkey@0"
I20260808 15:57:36.523432 4206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:36.539495 4206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:36.542111 4206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:36.542284 4206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:36.548936 4206 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:42803
I20260808 15:57:36.548960 4325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:42803 every 8 connection(s)
I20260808 15:57:36.549839 4206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:57:36.552492 4326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:36.552802 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 4206
I20260808 15:57:36.552938 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:57:36.553251 19828 external_mini_cluster.cc:1428] Setting key b460fd31d962239d359865d7dff64679
I20260808 15:57:36.559046 4326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b: Bootstrap starting.
I20260808 15:57:36.561604 4326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b: Neither blocks nor log segments found. Creating new log.
Aug 08 15:57:36 dist-test-slave-lgr5 krb5kdc[4189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:57:36.562299 4326 log.cc:824] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:36.564010 4326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b: No bootstrap required, opened a new log
I20260808 15:57:36.566504 4329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:36.554539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57924 (local address 127.19.93.62:42803)
0808 15:57:36.554918 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:36.554932 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:36.554967 (+ 35us) server_negotiation.cc:407] Connection header received
0808 15:57:36.555664 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:36.555680 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:36.555984 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:36.556284 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:36.557113 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:36.558056 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:36.559199 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:36.559655 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:36.559770 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:36.562349 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:36.562355 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:36.562366 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:36.562392 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:36.563906 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:36.564356 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:36.564362 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:36.564366 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:36.564473 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:36.564738 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:36.564741 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:36.564743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:36.565119 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:36.565301 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:36.565566 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 15:57:36.565833 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":105,"threads_started":1}
I20260808 15:57:36.567517 4326 raft_consensus.cc:348] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65251b5d6f241f28db001dc46a7150b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42803 } }
I20260808 15:57:36.567780 4326 raft_consensus.cc:374] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:36.567839 4326 raft_consensus.cc:729] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a65251b5d6f241f28db001dc46a7150b, State: Initialized, Role: FOLLOWER
I20260808 15:57:36.568305 4326 consensus_queue.cc:260] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65251b5d6f241f28db001dc46a7150b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42803 } }
I20260808 15:57:36.568470 4326 raft_consensus.cc:388] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:57:36.568540 4326 raft_consensus.cc:482] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:57:36.568636 4326 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:36.569450 4326 raft_consensus.cc:504] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65251b5d6f241f28db001dc46a7150b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42803 } }
I20260808 15:57:36.569758 4326 leader_election.cc:302] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a65251b5d6f241f28db001dc46a7150b; no voters:
I20260808 15:57:36.570036 4326 leader_election.cc:288] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:57:36.570117 4332 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:36.570317 4332 raft_consensus.cc:686] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [term 1 LEADER]: Becoming Leader. State: Replica: a65251b5d6f241f28db001dc46a7150b, State: Running, Role: LEADER
I20260808 15:57:36.570605 4332 consensus_queue.cc:237] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65251b5d6f241f28db001dc46a7150b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42803 } }
I20260808 15:57:36.571187 4326 sys_catalog.cc:564] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:57:36.572350 4334 sys_catalog.cc:455] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a65251b5d6f241f28db001dc46a7150b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65251b5d6f241f28db001dc46a7150b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42803 } } }
I20260808 15:57:36.572484 4334 sys_catalog.cc:458] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [sys.catalog]: This master's current role is: LEADER
I20260808 15:57:36.572751 4335 sys_catalog.cc:455] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [sys.catalog]: SysCatalogTable state changed. Reason: New leader a65251b5d6f241f28db001dc46a7150b. Latest consensus state: current_term: 1 leader_uuid: "a65251b5d6f241f28db001dc46a7150b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65251b5d6f241f28db001dc46a7150b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42803 } } }
I20260808 15:57:36.572829 4335 sys_catalog.cc:458] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b [sys.catalog]: This master's current role is: LEADER
W20260808 15:57:36.575752 4360 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:57:36.575817 4360 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:57:36.575934 4346 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:57:36.576682 4346 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:57:36.581228 4346 catalog_manager.cc:1347] Generated new cluster ID: 9d5e93fc817546ddab33a06b5a5a50bd
I20260808 15:57:36.581290 4346 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:57:36.598065 4346 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:57:36.599218 4346 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:57:36.607350 4346 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b: Generated new TSK 0
I20260808 15:57:36.608071 4346 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 15:57:36.638618 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42803
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:44701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:36.745858 4368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:36.746068 4368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:36.746109 4368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:36.749962 4368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:36.750010 4368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:36.750075 4368 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:57:36.754993 4368 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:44701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:36.755884 4368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:36.756839 4368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:36.765717 4379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:36.765908 4368 server_base.cc:1034] running on GCE node
W20260808 15:57:36.765691 4386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:36.765699 4380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:36.766439 4368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:36.766995 4368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:36.768132 4368 hybrid_clock.cc:648] HybridClock initialized: now 1786204656768116 us; error 27 us; skew 500 ppm
Aug 08 15:57:36 dist-test-slave-lgr5 krb5kdc[4189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204656, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:36.770669 4368 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:57:36.771490 4368 webserver.cc:460] Webserver started at http://127.19.93.1:33767/ using document root <none> and password file <none>
I20260808 15:57:36.772034 4368 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:36.772151 4368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:36.772358 4368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:36.774297 4368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "fd5688b00bd54c3597d9545faf7ed099"
format_stamp: "Formatted at 2026-08-08 15:57:36 on dist-test-slave-lgr5"
server_key: "4310c24a794e51a4bb334ddcc29f48a7"
server_key_iv: "76476f7c9b050165c893a807d4a21b84"
server_key_version: "encryptionkey@0"
I20260808 15:57:36.774788 4368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "fd5688b00bd54c3597d9545faf7ed099"
format_stamp: "Formatted at 2026-08-08 15:57:36 on dist-test-slave-lgr5"
server_key: "4310c24a794e51a4bb334ddcc29f48a7"
server_key_iv: "76476f7c9b050165c893a807d4a21b84"
server_key_version: "encryptionkey@0"
I20260808 15:57:36.778169 4368 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 15:57:36.780366 4400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:36.781438 4368 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 15:57:36.781533 4368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "fd5688b00bd54c3597d9545faf7ed099"
format_stamp: "Formatted at 2026-08-08 15:57:36 on dist-test-slave-lgr5"
server_key: "4310c24a794e51a4bb334ddcc29f48a7"
server_key_iv: "76476f7c9b050165c893a807d4a21b84"
server_key_version: "encryptionkey@0"
I20260808 15:57:36.781611 4368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:36.796583 4368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:36.799367 4368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:36.799501 4368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:36.799969 4368 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:36.800729 4368 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:36.800773 4368 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:36.800809 4368 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:36.800828 4368 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:36.808959 4368 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:36395
I20260808 15:57:36.808977 4608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:36395 every 8 connection(s)
I20260808 15:57:36.809742 4368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:57:36.813988 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 4368
I20260808 15:57:36.814090 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:57:36.814363 19828 external_mini_cluster.cc:1428] Setting key 693ae86053647b8e911967f6e8b5628d
Aug 08 15:57:36 dist-test-slave-lgr5 krb5kdc[4189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204656, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:57:36.822849 4329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:36.811354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:47449 (local address 127.19.93.62:42803)
0808 15:57:36.811477 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:36.811481 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:36.812310 (+ 829us) server_negotiation.cc:407] Connection header received
0808 15:57:36.813639 (+ 1329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:36.813643 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:36.813701 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:36.813797 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:36.814951 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:36.815491 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:36.816623 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:36.816847 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:36.816935 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:36.819528 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:36.819532 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:36.819534 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:36.819557 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:36.820899 (+ 1342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:36.821467 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:36.821469 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:36.821471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:36.821535 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:36.821874 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:36.821876 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:36.821877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:36.822037 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:36.822103 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:36.822644 (+ 541us) server_negotiation.cc:299] Negotiation successful
0808 15:57:36.822734 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:57:36.823928 4616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:36.811657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42803 (local address 127.19.93.1:47449)
0808 15:57:36.812155 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:36.812216 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:36.813437 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:36.813946 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:36.813953 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:36.814335 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:36.814807 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:36.814820 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:36.815613 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:36.815617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:36.816505 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:36.816515 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:36.816979 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:36.816983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:36.817146 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:36.817695 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:36.817715 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:36.819352 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:36.821015 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:36.821021 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:36.821035 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:36.821378 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:36.821612 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:36.821616 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:36.821617 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:36.821793 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:36.822129 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:36.822136 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:36.822422 (+ 286us) client_negotiation.cc:769] Sending connection context
0808 15:57:36.822629 (+ 207us) client_negotiation.cc:240] Negotiation successful
0808 15:57:36.822942 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":103,"threads_started":1}
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
I20260808 15:57:36.825049 4610 heartbeater.cc:347] Connected to a master server at 127.19.93.62:42803
I20260808 15:57:36.825256 4610 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:36.825688 4610 heartbeater.cc:511] Master 127.19.93.62:42803 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
I20260808 15:57:36.827207 4264 ts_manager.cc:194] Registered new tserver with Master: fd5688b00bd54c3597d9545faf7ed099 (127.19.93.1:36395)
I20260808 15:57:36.828814 4264 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:47449
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 15:57:36.841012 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42803
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:44701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:36.947230 4622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:36.947456 4622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:36.947497 4622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:36.951357 4622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:36.951408 4622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:36.951462 4622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:57:36.956429 4622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:44701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:36.957343 4622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:36.958274 4622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:36.967587 4634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:36.967576 4633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:36.967742 4622 server_base.cc:1034] running on GCE node
W20260808 15:57:36.967605 4640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:36.968214 4622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:36.968777 4622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:36.969928 4622 hybrid_clock.cc:648] HybridClock initialized: now 1786204656969905 us; error 33 us; skew 500 ppm
Aug 08 15:57:36 dist-test-slave-lgr5 krb5kdc[4189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204656, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:36.972604 4622 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:57:36.973520 4622 webserver.cc:460] Webserver started at http://127.19.93.2:33865/ using document root <none> and password file <none>
I20260808 15:57:36.974036 4622 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:36.974112 4622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:36.974309 4622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:36.976310 4622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "b4ce1e8fa4fa471499daeaf797a34936"
format_stamp: "Formatted at 2026-08-08 15:57:36 on dist-test-slave-lgr5"
server_key: "28808c05ee88da1158bdba7fce8cbb1c"
server_key_iv: "5872f7708a25a034b29f10d0db678692"
server_key_version: "encryptionkey@0"
I20260808 15:57:36.976841 4622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "b4ce1e8fa4fa471499daeaf797a34936"
format_stamp: "Formatted at 2026-08-08 15:57:36 on dist-test-slave-lgr5"
server_key: "28808c05ee88da1158bdba7fce8cbb1c"
server_key_iv: "5872f7708a25a034b29f10d0db678692"
server_key_version: "encryptionkey@0"
I20260808 15:57:36.980326 4622 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:57:36.982542 4654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:36.983625 4622 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:57:36.983741 4622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "b4ce1e8fa4fa471499daeaf797a34936"
format_stamp: "Formatted at 2026-08-08 15:57:36 on dist-test-slave-lgr5"
server_key: "28808c05ee88da1158bdba7fce8cbb1c"
server_key_iv: "5872f7708a25a034b29f10d0db678692"
server_key_version: "encryptionkey@0"
I20260808 15:57:36.983829 4622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:37.004011 4622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:37.006712 4622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:37.006884 4622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:37.007459 4622 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:37.008302 4622 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:37.008353 4622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:37.008406 4622 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:37.008433 4622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:37.016813 4622 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:39195
I20260808 15:57:37.016844 4831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:39195 every 8 connection(s)
I20260808 15:57:37.017659 4622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:57:37.026640 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 4622
Aug 08 15:57:37 dist-test-slave-lgr5 krb5kdc[4189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204656, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:57:37.026753 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:57:37.027105 19828 external_mini_cluster.cc:1428] Setting key 02aaa62fc4a2f03b72979055e4a69136
I20260808 15:57:37.030659 4329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.019341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:45421 (local address 127.19.93.62:42803)
0808 15:57:37.019501 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:37.019505 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:37.020280 (+ 775us) server_negotiation.cc:407] Connection header received
0808 15:57:37.021634 (+ 1354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:37.021638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:37.021692 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:37.021769 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:37.022864 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.023404 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.024566 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.024788 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.024876 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:37.027355 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:37.027359 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:37.027361 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:37.027386 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:37.028849 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:37.029302 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:37.029306 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:37.029307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:37.029396 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:37.029672 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:37.029675 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:37.029677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:37.029875 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:37.029970 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:37.030377 (+ 407us) server_negotiation.cc:299] Negotiation successful
0808 15:57:37.030495 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 15:57:37.031522 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.019697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42803 (local address 127.19.93.2:45421)
0808 15:57:37.020144 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:37.020185 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:37.021438 (+ 1253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:37.021941 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:37.021948 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:37.022281 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:37.022724 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:37.022738 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.023524 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.023527 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:37.024450 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:37.024461 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.024931 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.024935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:37.025088 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:37.025600 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:37.025616 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:37.027191 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:37.028955 (+ 1764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:37.028960 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:37.028970 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:37.029207 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:37.029480 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:37.029482 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:37.029483 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:37.029601 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:37.029959 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:37.029964 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:37.030170 (+ 206us) client_negotiation.cc:769] Sending connection context
0808 15:57:37.030311 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 15:57:37.030549 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":101,"threads_started":1}
I20260808 15:57:37.032578 4832 heartbeater.cc:347] Connected to a master server at 127.19.93.62:42803
I20260808 15:57:37.032792 4832 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:37.033303 4832 heartbeater.cc:511] Master 127.19.93.62:42803 requested a full tablet report, sending...
I20260808 15:57:37.034390 4264 ts_manager.cc:194] Registered new tserver with Master: b4ce1e8fa4fa471499daeaf797a34936 (127.19.93.2:39195)
I20260808 15:57:37.035140 4264 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:45421
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 15:57:37.052963 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42803
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:44701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:57:37.165727 4841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:57:37.165977 4841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:57:37.166028 4841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:57:37.169996 4841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:57:37.170058 4841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:57:37.170145 4841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:57:37.175463 4841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:44701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:42803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:57:37.176512 4841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:57:37.177521 4841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:57:37.187157 4856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:37.187160 4853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:57:37.187130 4854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:57:37.187299 4841 server_base.cc:1034] running on GCE node
I20260808 15:57:37.187832 4841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:57:37.188473 4841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:57:37.189637 4841 hybrid_clock.cc:648] HybridClock initialized: now 1786204657189623 us; error 32 us; skew 500 ppm
Aug 08 15:57:37 dist-test-slave-lgr5 krb5kdc[4189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204657, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:57:37.192168 4841 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:57:37.192952 4841 webserver.cc:460] Webserver started at http://127.19.93.3:44525/ using document root <none> and password file <none>
I20260808 15:57:37.193478 4841 fs_manager.cc:359] Metadata directory not provided
I20260808 15:57:37.193542 4841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:57:37.193725 4841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:57:37.195681 4841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "09bd510b0e8b491eaec40d60bac2f6e2"
format_stamp: "Formatted at 2026-08-08 15:57:37 on dist-test-slave-lgr5"
server_key: "8cf6d9ce55c345c2f5dbb3421ba8345e"
server_key_iv: "119b7efee81c22f7709bf86f1d5016e3"
server_key_version: "encryptionkey@0"
I20260808 15:57:37.196250 4841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "09bd510b0e8b491eaec40d60bac2f6e2"
format_stamp: "Formatted at 2026-08-08 15:57:37 on dist-test-slave-lgr5"
server_key: "8cf6d9ce55c345c2f5dbb3421ba8345e"
server_key_iv: "119b7efee81c22f7709bf86f1d5016e3"
server_key_version: "encryptionkey@0"
I20260808 15:57:37.199709 4841 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:57:37.201965 4874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:37.203063 4841 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 15:57:37.203167 4841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "09bd510b0e8b491eaec40d60bac2f6e2"
format_stamp: "Formatted at 2026-08-08 15:57:37 on dist-test-slave-lgr5"
server_key: "8cf6d9ce55c345c2f5dbb3421ba8345e"
server_key_iv: "119b7efee81c22f7709bf86f1d5016e3"
server_key_version: "encryptionkey@0"
I20260808 15:57:37.203253 4841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:57:37.218631 4841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:57:37.221328 4841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:57:37.221493 4841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:57:37.222035 4841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:57:37.222813 4841 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:57:37.222859 4841 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:37.222911 4841 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:57:37.222940 4841 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:57:37.231201 4841 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:37673
I20260808 15:57:37.231235 5062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:37673 every 8 connection(s)
I20260808 15:57:37.232003 4841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:57:37.238708 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 4841
I20260808 15:57:37.238837 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:57:37.239109 19828 external_mini_cluster.cc:1428] Setting key a6dcf3e47fe96fe8dff1996831821e74
Aug 08 15:57:37 dist-test-slave-lgr5 krb5kdc[4189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204657, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:57:37.244623 4329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.233724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:53473 (local address 127.19.93.62:42803)
0808 15:57:37.233870 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:37.233875 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:37.234698 (+ 823us) server_negotiation.cc:407] Connection header received
0808 15:57:37.236004 (+ 1306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:37.236007 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:37.236055 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:37.236141 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:37.237173 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.237690 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.238950 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.239170 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.239263 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:37.241713 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:37.241716 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:37.241718 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:37.241742 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:37.243042 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:37.243427 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:37.243431 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:37.243433 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:37.243504 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:37.243744 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:37.243746 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:37.243747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:37.243897 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:37.243979 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:37.244411 (+ 432us) server_negotiation.cc:299] Negotiation successful
0808 15:57:37.244508 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:57:37.245363 5066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.234121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:42803 (local address 127.19.93.3:53473)
0808 15:57:37.234552 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:37.234592 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:37.235822 (+ 1230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:37.236273 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:37.236280 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:37.236601 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:57:37.237037 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:37.237063 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.237777 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.237779 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:37.238749 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:37.238761 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.239317 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.239321 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:37.239490 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:37.239998 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:57:37.240018 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:57:37.241570 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:57:37.243124 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:37.243127 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:37.243136 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:37.243357 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:37.243570 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:57:37.243572 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:57:37.243573 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:57:37.243684 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:57:37.243977 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:57:37.243982 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:57:37.244226 (+ 244us) client_negotiation.cc:769] Sending connection context
0808 15:57:37.244372 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 15:57:37.244605 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":114,"threads_started":1}
I20260808 15:57:37.246418 5063 heartbeater.cc:347] Connected to a master server at 127.19.93.62:42803
I20260808 15:57:37.246626 5063 heartbeater.cc:464] Registering TS with master...
I20260808 15:57:37.247066 5063 heartbeater.cc:511] Master 127.19.93.62:42803 requested a full tablet report, sending...
I20260808 15:57:37.248008 4264 ts_manager.cc:194] Registered new tserver with Master: 09bd510b0e8b491eaec40d60bac2f6e2 (127.19.93.3:37673)
I20260808 15:57:37.248581 4264 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:53473
I20260808 15:57:37.252662 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:57:37.261206 4329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.254423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57928 (local address 127.19.93.62:42803)
0808 15:57:37.254525 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:37.254529 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:37.254690 (+ 161us) server_negotiation.cc:407] Connection header received
0808 15:57:37.254797 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:37.254800 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:37.254840 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:37.254916 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:57:37.255557 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.256039 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.256862 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.257074 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.257158 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:37.258386 (+ 1228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:57:37.258389 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:57:37.258391 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:57:37.258413 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:57:37.259665 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:37.260046 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:37.260050 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:37.260051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:37.260170 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:57:37.260411 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:57:37.260415 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:57:37.260416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:57:37.260614 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:57:37.260730 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:37.260961 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 15:57:37.261068 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 15:57:37.263826 4264 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57928:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:57:37.266763 4264 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:57:37.280639 5090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.275249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:37673 (local address 127.0.0.1:44146)
0808 15:57:37.276200 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:37.276212 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:37.276297 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:37.276774 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:37.276777 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:37.276796 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:37.276869 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:37.276874 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.278157 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.278160 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:37.279040 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:37.279050 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.280010 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.280014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:37.280184 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:37.280231 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 15:57:37.280348 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 15:57:37.280487 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":893,"mutex_wait_us":6,"thread_start_us":84,"threads_started":1}
I20260808 15:57:37.280670 5088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.274840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51138 (local address 127.19.93.1:36395)
0808 15:57:37.275258 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:37.275270 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:37.275702 (+ 432us) server_negotiation.cc:407] Connection header received
0808 15:57:37.275780 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:37.275784 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:37.275969 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:37.276156 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:37.276632 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.277496 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.279045 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.279830 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.279935 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:37.280105 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:37.280451 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 15:57:37.280543 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":91,"threads_started":1}
I20260808 15:57:37.280681 5089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.274863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41868 (local address 127.19.93.2:39195)
0808 15:57:37.275472 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:37.275483 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:37.275507 (+ 24us) server_negotiation.cc:407] Connection header received
0808 15:57:37.275671 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:37.275677 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:37.275911 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:37.276571 (+ 660us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:37.276740 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.277905 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.279311 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.280101 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.280203 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:37.280328 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:37.280441 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 15:57:37.280542 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":115,"threads_started":1}
I20260808 15:57:37.281136 5091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.275659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44146 (local address 127.19.93.3:37673)
0808 15:57:37.276059 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:37.276070 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:37.276395 (+ 325us) server_negotiation.cc:407] Connection header received
0808 15:57:37.276471 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:37.276475 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:37.276642 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:37.276785 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:37.276987 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.278042 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.279188 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.279773 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.279890 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:37.280037 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:37.280917 (+ 880us) server_negotiation.cc:299] Negotiation successful
0808 15:57:37.281006 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":160,"threads_started":1}
I20260808 15:57:37.280647 5085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.274540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:39195 (local address 127.0.0.1:41868)
0808 15:57:37.275304 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:37.275353 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:37.275482 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:37.276280 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:37.276286 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:37.276305 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:37.276466 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:37.276473 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.278053 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.278057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:37.279180 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:37.279189 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.280205 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.280208 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:37.280299 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:37.280320 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 15:57:37.280394 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 15:57:37.280497 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"mutex_wait_us":52,"thread_start_us":71,"threads_started":1}
I20260808 15:57:37.281015 5086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.274631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:36395 (local address 127.0.0.1:51138)
0808 15:57:37.275388 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:37.275402 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:37.275501 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:37.276320 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:37.276323 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:37.276340 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:37.276486 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:37.276494 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.277633 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.277636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:37.278897 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:37.278909 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.280158 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.280162 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:37.280258 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:37.280277 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 15:57:37.280336 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 15:57:37.280903 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"mutex_wait_us":521,"thread_start_us":103,"threads_started":1}
I20260808 15:57:37.284343 4957 tablet_service.cc:1467] Processing CreateTablet for tablet 4f4d99d301064a2abc560625d345a9aa (DEFAULT_TABLE table=test-table [id=daa2039981bc4ebf90d6c1c6785797fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:37.284344 4733 tablet_service.cc:1467] Processing CreateTablet for tablet 4f4d99d301064a2abc560625d345a9aa (DEFAULT_TABLE table=test-table [id=daa2039981bc4ebf90d6c1c6785797fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:37.285481 4733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f4d99d301064a2abc560625d345a9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:37.285485 4957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f4d99d301064a2abc560625d345a9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:37.286623 4492 tablet_service.cc:1467] Processing CreateTablet for tablet 4f4d99d301064a2abc560625d345a9aa (DEFAULT_TABLE table=test-table [id=daa2039981bc4ebf90d6c1c6785797fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:57:37.287503 4492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f4d99d301064a2abc560625d345a9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:57:37.292775 5093 tablet_bootstrap.cc:492] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936: Bootstrap starting.
I20260808 15:57:37.293187 5092 tablet_bootstrap.cc:492] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2: Bootstrap starting.
I20260808 15:57:37.293922 5094 tablet_bootstrap.cc:492] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099: Bootstrap starting.
I20260808 15:57:37.295562 5094 tablet_bootstrap.cc:654] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:37.295594 5092 tablet_bootstrap.cc:654] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:37.296506 5092 log.cc:824] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:37.296727 5094 log.cc:824] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:37.297950 5093 tablet_bootstrap.cc:654] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936: Neither blocks nor log segments found. Creating new log.
I20260808 15:57:37.298445 5094 tablet_bootstrap.cc:492] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099: No bootstrap required, opened a new log
I20260808 15:57:37.298629 5094 ts_tablet_manager.cc:1397] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 15:57:37.298686 5093 log.cc:824] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936: Log is configured to *not* fsync() on all Append() calls
I20260808 15:57:37.299711 5092 tablet_bootstrap.cc:492] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2: No bootstrap required, opened a new log
I20260808 15:57:37.299889 5092 ts_tablet_manager.cc:1397] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 15:57:37.300240 5093 tablet_bootstrap.cc:492] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936: No bootstrap required, opened a new log
I20260808 15:57:37.300411 5093 ts_tablet_manager.cc:1397] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260808 15:57:37.302502 5094 raft_consensus.cc:348] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ce1e8fa4fa471499daeaf797a34936" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39195 } } peers { permanent_uuid: "fd5688b00bd54c3597d9545faf7ed099" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36395 } } peers { permanent_uuid: "09bd510b0e8b491eaec40d60bac2f6e2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37673 } }
I20260808 15:57:37.302769 5094 raft_consensus.cc:374] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:37.302826 5094 raft_consensus.cc:729] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd5688b00bd54c3597d9545faf7ed099, State: Initialized, Role: FOLLOWER
I20260808 15:57:37.303316 5094 consensus_queue.cc:260] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ce1e8fa4fa471499daeaf797a34936" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39195 } } peers { permanent_uuid: "fd5688b00bd54c3597d9545faf7ed099" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36395 } } peers { permanent_uuid: "09bd510b0e8b491eaec40d60bac2f6e2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37673 } }
I20260808 15:57:37.303233 5093 raft_consensus.cc:348] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ce1e8fa4fa471499daeaf797a34936" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39195 } } peers { permanent_uuid: "fd5688b00bd54c3597d9545faf7ed099" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36395 } } peers { permanent_uuid: "09bd510b0e8b491eaec40d60bac2f6e2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37673 } }
I20260808 15:57:37.303483 5093 raft_consensus.cc:374] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:37.303540 5093 raft_consensus.cc:729] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4ce1e8fa4fa471499daeaf797a34936, State: Initialized, Role: FOLLOWER
I20260808 15:57:37.303915 5093 consensus_queue.cc:260] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ce1e8fa4fa471499daeaf797a34936" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39195 } } peers { permanent_uuid: "fd5688b00bd54c3597d9545faf7ed099" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36395 } } peers { permanent_uuid: "09bd510b0e8b491eaec40d60bac2f6e2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37673 } }
I20260808 15:57:37.303810 5092 raft_consensus.cc:348] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ce1e8fa4fa471499daeaf797a34936" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39195 } } peers { permanent_uuid: "fd5688b00bd54c3597d9545faf7ed099" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36395 } } peers { permanent_uuid: "09bd510b0e8b491eaec40d60bac2f6e2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37673 } }
I20260808 15:57:37.304032 5092 raft_consensus.cc:374] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:57:37.304106 5092 raft_consensus.cc:729] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09bd510b0e8b491eaec40d60bac2f6e2, State: Initialized, Role: FOLLOWER
I20260808 15:57:37.304361 5094 ts_tablet_manager.cc:1428] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 15:57:37.304705 4610 heartbeater.cc:503] Master 127.19.93.62:42803 was elected leader, sending a full tablet report...
I20260808 15:57:37.304728 5093 ts_tablet_manager.cc:1428] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260808 15:57:37.305055 4832 heartbeater.cc:503] Master 127.19.93.62:42803 was elected leader, sending a full tablet report...
I20260808 15:57:37.304489 5092 consensus_queue.cc:260] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ce1e8fa4fa471499daeaf797a34936" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39195 } } peers { permanent_uuid: "fd5688b00bd54c3597d9545faf7ed099" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36395 } } peers { permanent_uuid: "09bd510b0e8b491eaec40d60bac2f6e2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37673 } }
I20260808 15:57:37.306149 5063 heartbeater.cc:503] Master 127.19.93.62:42803 was elected leader, sending a full tablet report...
I20260808 15:57:37.306468 5092 ts_tablet_manager.cc:1428] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260808 15:57:37.310849 4614 tablet.cc:2369] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:57:37.418141 5107 raft_consensus.cc:482] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:57:37.418357 5107 raft_consensus.cc:504] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ce1e8fa4fa471499daeaf797a34936" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39195 } } peers { permanent_uuid: "fd5688b00bd54c3597d9545faf7ed099" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36395 } } peers { permanent_uuid: "09bd510b0e8b491eaec40d60bac2f6e2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37673 } }
I20260808 15:57:37.419509 5107 leader_election.cc:288] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4ce1e8fa4fa471499daeaf797a34936 (127.19.93.2:39195), fd5688b00bd54c3597d9545faf7ed099 (127.19.93.1:36395)
I20260808 15:57:37.423226 5066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.419781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:39195 (local address 127.19.93.3:36091)
0808 15:57:37.419887 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:37.419902 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:37.420000 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:37.420272 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:37.420275 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:37.420298 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:37.420415 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:37.420421 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.421284 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.421287 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:37.422139 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:37.422149 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.422831 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.422834 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:37.422935 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:37.422958 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:57:37.423032 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 15:57:37.423100 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 15:57:37.423290 5089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.419890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:36091 (local address 127.19.93.2:39195)
0808 15:57:37.420020 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:37.420024 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:37.420040 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:57:37.420113 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:37.420115 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:37.420158 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:37.420233 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:37.420540 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.421186 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.422263 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.422725 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.422826 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:37.422902 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:37.423067 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 15:57:37.423150 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 15:57:37.423719 5108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.419781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:36395 (local address 127.19.93.3:43331)
0808 15:57:37.420472 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:37.420487 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:57:37.420589 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:57:37.420790 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:57:37.420793 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:57:37.420809 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:57:37.420921 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:37.420927 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.421564 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.421568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:37.422483 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:57:37.422493 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.423210 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.423213 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:57:37.423433 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:37.423459 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 15:57:37.423517 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 15:57:37.423576 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"mutex_wait_us":331,"thread_start_us":128,"threads_started":1}
I20260808 15:57:37.423748 5088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.419868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:43331 (local address 127.19.93.1:36395)
0808 15:57:37.420017 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:37.420022 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:37.420573 (+ 551us) server_negotiation.cc:407] Connection header received
0808 15:57:37.420664 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:37.420666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:37.420709 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:37.420764 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:57:37.421009 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.421458 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.422605 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.423095 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.423196 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:37.423252 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:37.423572 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 15:57:37.423637 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 15:57:37.424057 4762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f4d99d301064a2abc560625d345a9aa" candidate_uuid: "09bd510b0e8b491eaec40d60bac2f6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4ce1e8fa4fa471499daeaf797a34936" is_pre_election: true
I20260808 15:57:37.424402 4762 raft_consensus.cc:2454] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09bd510b0e8b491eaec40d60bac2f6e2 in term 0.
I20260808 15:57:37.424453 4538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f4d99d301064a2abc560625d345a9aa" candidate_uuid: "09bd510b0e8b491eaec40d60bac2f6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd5688b00bd54c3597d9545faf7ed099" is_pre_election: true
I20260808 15:57:37.424692 4538 raft_consensus.cc:2454] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09bd510b0e8b491eaec40d60bac2f6e2 in term 0.
I20260808 15:57:37.424860 4883 leader_election.cc:302] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09bd510b0e8b491eaec40d60bac2f6e2, b4ce1e8fa4fa471499daeaf797a34936; no voters:
I20260808 15:57:37.425156 5107 raft_consensus.cc:2781] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:57:37.425236 5107 raft_consensus.cc:482] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:57:37.425266 5107 raft_consensus.cc:3037] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:37.426316 5107 raft_consensus.cc:504] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ce1e8fa4fa471499daeaf797a34936" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39195 } } peers { permanent_uuid: "fd5688b00bd54c3597d9545faf7ed099" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36395 } } peers { permanent_uuid: "09bd510b0e8b491eaec40d60bac2f6e2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37673 } }
I20260808 15:57:37.426656 5107 leader_election.cc:288] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [CANDIDATE]: Term 1 election: Requested vote from peers b4ce1e8fa4fa471499daeaf797a34936 (127.19.93.2:39195), fd5688b00bd54c3597d9545faf7ed099 (127.19.93.1:36395)
I20260808 15:57:37.426965 4762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f4d99d301064a2abc560625d345a9aa" candidate_uuid: "09bd510b0e8b491eaec40d60bac2f6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4ce1e8fa4fa471499daeaf797a34936"
I20260808 15:57:37.427009 4538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f4d99d301064a2abc560625d345a9aa" candidate_uuid: "09bd510b0e8b491eaec40d60bac2f6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd5688b00bd54c3597d9545faf7ed099"
I20260808 15:57:37.427116 4538 raft_consensus.cc:3037] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:37.427117 4762 raft_consensus.cc:3037] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:57:37.428395 4538 raft_consensus.cc:2454] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09bd510b0e8b491eaec40d60bac2f6e2 in term 1.
I20260808 15:57:37.428399 4762 raft_consensus.cc:2454] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09bd510b0e8b491eaec40d60bac2f6e2 in term 1.
I20260808 15:57:37.428673 4884 leader_election.cc:302] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09bd510b0e8b491eaec40d60bac2f6e2, fd5688b00bd54c3597d9545faf7ed099; no voters:
I20260808 15:57:37.428846 5107 raft_consensus.cc:2781] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:57:37.429059 5107 raft_consensus.cc:686] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 09bd510b0e8b491eaec40d60bac2f6e2, State: Running, Role: LEADER
I20260808 15:57:37.429347 5107 consensus_queue.cc:237] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ce1e8fa4fa471499daeaf797a34936" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39195 } } peers { permanent_uuid: "fd5688b00bd54c3597d9545faf7ed099" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36395 } } peers { permanent_uuid: "09bd510b0e8b491eaec40d60bac2f6e2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37673 } }
I20260808 15:57:37.431962 4258 catalog_manager.cc:5495] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09bd510b0e8b491eaec40d60bac2f6e2 (127.19.93.3). New cstate: current_term: 1 leader_uuid: "09bd510b0e8b491eaec40d60bac2f6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4ce1e8fa4fa471499daeaf797a34936" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd5688b00bd54c3597d9545faf7ed099" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09bd510b0e8b491eaec40d60bac2f6e2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37673 } health_report { overall_health: HEALTHY } } }
I20260808 15:57:37.467299 5091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.463815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44162 (local address 127.19.93.3:37673)
0808 15:57:37.463960 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 15:57:37.463964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:57:37.463978 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:57:37.464130 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:57:37.464132 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:57:37.464186 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:57:37.464273 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:57:37.464522 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.465006 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.465869 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:57:37.466092 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:57:37.466180 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:57:37.466479 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:57:37.466891 (+ 412us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:57:37.466997 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 15:57:37.467087 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 15:57:37.467144 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 15:57:37.472911 4538 raft_consensus.cc:1261] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099 [term 1 FOLLOWER]: Refusing update from remote peer 09bd510b0e8b491eaec40d60bac2f6e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:37.472908 4762 raft_consensus.cc:1261] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936 [term 1 FOLLOWER]: Refusing update from remote peer 09bd510b0e8b491eaec40d60bac2f6e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:57:37.473565 5110 consensus_queue.cc:1035] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4ce1e8fa4fa471499daeaf797a34936" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 39195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:37.473757 5107 consensus_queue.cc:1035] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd5688b00bd54c3597d9545faf7ed099" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:57:37.480798 5115 mvcc.cc:205] Tried to move back new op lower bound from 7316294277002256384 to 7316294276833013760. Current Snapshot: MvccSnapshot[applied={T|T < 7316294277002256384}]
I20260808 15:57:37.481184 5119 mvcc.cc:205] Tried to move back new op lower bound from 7316294277002256384 to 7316294276833013760. Current Snapshot: MvccSnapshot[applied={T|T < 7316294277002256384}]
I20260808 15:57:37.483601 5116 mvcc.cc:205] Tried to move back new op lower bound from 7316294277002256384 to 7316294276833013760. Current Snapshot: MvccSnapshot[applied={T|T < 7316294277002256384 or (T in {7316294277002256384})}]
I20260808 15:57:37.489262 4264 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57928:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:37.489434 4264 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57928:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:57:37.491788 4264 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a65251b5d6f241f28db001dc46a7150b: Sending DeleteTablet for 3 replicas of tablet 4f4d99d301064a2abc560625d345a9aa
I20260808 15:57:37.492540 4733 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f4d99d301064a2abc560625d345a9aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:37 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:41868
I20260808 15:57:37.492712 4492 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f4d99d301064a2abc560625d345a9aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:37 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:51138
I20260808 15:57:37.493144 5129 tablet_replica.cc:330] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099: stopping tablet replica
I20260808 15:57:37.493151 4957 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f4d99d301064a2abc560625d345a9aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:57:37 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:44146
I20260808 15:57:37.493448 5129 raft_consensus.cc:2229] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:37.493582 5130 tablet_replica.cc:330] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2: stopping tablet replica
I20260808 15:57:37.493731 5129 raft_consensus.cc:2258] T 4f4d99d301064a2abc560625d345a9aa P fd5688b00bd54c3597d9545faf7ed099 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:37.493853 5130 raft_consensus.cc:2229] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:57:37.494210 5130 raft_consensus.cc:2258] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:37.494283 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 4368
I20260808 15:57:37.498754 5130 ts_tablet_manager.cc:1905] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:37.501523 5130 ts_tablet_manager.cc:1918] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:37.501626 5130 log.cc:1196] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/4f4d99d301064a2abc560625d345a9aa
I20260808 15:57:37.501936 5130 ts_tablet_manager.cc:1939] T 4f4d99d301064a2abc560625d345a9aa P 09bd510b0e8b491eaec40d60bac2f6e2: Deleting consensus metadata
I20260808 15:57:37.503098 4239 catalog_manager.cc:4841] TS 09bd510b0e8b491eaec40d60bac2f6e2 (127.19.93.3:37673): tablet 4f4d99d301064a2abc560625d345a9aa (table test-table [id=daa2039981bc4ebf90d6c1c6785797fb]) successfully deleted
I20260808 15:57:37.507522 5128 tablet_replica.cc:330] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936: stopping tablet replica
I20260808 15:57:37.507853 5128 raft_consensus.cc:2229] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:57:37.508195 5128 raft_consensus.cc:2258] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:57:37.509735 5128 ts_tablet_manager.cc:1905] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:57:37.512461 5128 ts_tablet_manager.cc:1918] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:57:37.512557 5128 log.cc:1196] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/4f4d99d301064a2abc560625d345a9aa
I20260808 15:57:37.512836 5128 ts_tablet_manager.cc:1939] T 4f4d99d301064a2abc560625d345a9aa P b4ce1e8fa4fa471499daeaf797a34936: Deleting consensus metadata
I20260808 15:57:37.514060 4237 catalog_manager.cc:4841] TS b4ce1e8fa4fa471499daeaf797a34936 (127.19.93.2:39195): tablet 4f4d99d301064a2abc560625d345a9aa (table test-table [id=daa2039981bc4ebf90d6c1c6785797fb]) successfully deleted
W20260808 15:57:37.514626 4239 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:36395 (error 108)
I20260808 15:57:37.515486 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 4622
I20260808 15:57:37.515712 5085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:57:37.515415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:36395 (local address 127.0.0.1:51148)
0808 15:57:37.515554 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 15:57:37.515630 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:36395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 15:57:37.524267 4239 catalog_manager.cc:4584] TS fd5688b00bd54c3597d9545faf7ed099 (127.19.93.1:36395): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4f4d99d301064a2abc560625d345a9aa: Network error: Client connection negotiation failed: client connection to 127.19.93.1:36395: connect: Connection refused (error 111)
I20260808 15:57:37.526580 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 4841
I20260808 15:57:37.540201 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 4206
2026-08-08T15:57:37Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2458 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:57:37 dist-test-slave-lgr5 krb5kdc[5136](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:57:37 dist-test-slave-lgr5 krb5kdc[5136](info): set up 2 sockets
Aug 08 15:57:37 dist-test-slave-lgr5 krb5kdc[5136](info): commencing operation
krb5kdc: starting...
W20260808 15:57:38.690442 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:57:38 dist-test-slave-lgr5 krb5kdc[5136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:57:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:57:38Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.19.93.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.19.93.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.19.93.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/rangeradmin_127.19.93.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.19.93.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/rangeradmin_127.19.93.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.19.93.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.19.93.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.19.93.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/rangerlookup_127.19.93.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.19.93.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/rangerlookup_127.19.93.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.93.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.19.93.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.93.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/HTTP_127.19.93.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.93.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/HTTP_127.19.93.20@KRBTEST.COM.keytab.
I20260808 15:57:38.848369 19828 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskeiRfxd/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/postgres -l logfile start
2026-08-08 15:57:41.147 UTC [5190] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 15:57:41.147 UTC [5190] LOG: listening on IPv4 address "127.19.93.20", port 41173
2026-08-08 15:57:41.151 UTC [5190] LOG: listening on Unix socket "/tmp/.s.PGSQL.41173"
2026-08-08 15:57:41.171 UTC [5197] LOG: database system was shut down at 2026-08-08 15:57:39 UTC
2026-08-08 15:57:41.174 UTC [5190] LOG: database system is ready to accept connections
I20260808 15:57:42.233587 19828 mini_postgres.cc:96] Postgres bound to 41173
2026-08-08 15:57:42.241 UTC [5207] FATAL: database "slave" does not exist
127.19.93.20:41173 - accepting connections
I20260808 15:57:42.242493 19828 mini_ranger.cc:161] Starting Ranger...
I20260808 15:57:42.257696 19828 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 15:57:42.680572 19828 mini_ranger.cc:87] Created ranger Postgres database
I20260808 15:57:42.680670 19828 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-admin
2026-08-08 15:57:43,001 [I] DB FLAVOR :POSTGRES
2026-08-08 15:57:43,001 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 15:57:43,001 [I] Checking connection..
2026-08-08 15:57:43,002 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 15:57:43,265 [I] Checking connection passed.
2026-08-08 15:57:43,265 [I] --------- Verifying version history table ---------
2026-08-08 15:57:43,266 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 15:57:43,507 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 15:57:43,507 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 15:57:43,747 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 15:57:43,747 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 15:57:43,748 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 15:57:43.980 UTC [5317] WARNING: there is no transaction in progress
2026-08-08 15:57:43,989 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 15:57:43,989 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 15:57:44,246 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 15:57:44,246 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 15:57:44,246 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 15:57:44,503 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 15:57:44,748 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-lgr5.c.gcp-upstream.internal','N') ;"
2026-08-08 15:57:44,993 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 15:57:45,227 [I] Table x_portal_user does not exist in database ranger
2026-08-08 15:57:45,227 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 15:57:45,484 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 15:57:45,485 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 15:57:45,749 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 15:57:45,998 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 15:57:45,998 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 15:57:46.896 UTC [5498] WARNING: there is no transaction in progress
2026-08-08 15:57:46.910 UTC [5498] WARNING: there is no transaction in progress
2026-08-08 15:57:46.925 UTC [5498] WARNING: there is no transaction in progress
2026-08-08 15:57:46.938 UTC [5498] WARNING: there is no transaction in progress
2026-08-08 15:57:46.952 UTC [5498] WARNING: there is no transaction in progress
2026-08-08 15:57:46.968 UTC [5498] WARNING: there is no transaction in progress
2026-08-08 15:57:47.018 UTC [5498] WARNING: there is no transaction in progress
2026-08-08 15:57:47.024 UTC [5498] WARNING: there is no transaction in progress
2026-08-08 15:57:47.038 UTC [5498] WARNING: there is no transaction in progress
2026-08-08 15:57:47.047 UTC [5498] WARNING: there is no transaction in progress
2026-08-08 15:57:47.057 UTC [5498] WARNING: there is no transaction in progress
2026-08-08 15:57:47.070 UTC [5498] WARNING: there is no transaction in progress
2026-08-08 15:57:47.078 UTC [5498] WARNING: there is no transaction in progress
2026-08-08 15:57:47.084 UTC [5498] WARNING: there is no transaction in progress
2026-08-08 15:57:47.089 UTC [5498] WARNING: there is no transaction in progress
2026-08-08 15:57:47.095 UTC [5498] WARNING: there is no transaction in progress
2026-08-08 15:57:47,660 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 15:57:47,660 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 15:57:47,907 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 15:57:47,907 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 15:57:48,163 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 15:57:48,163 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 15:57:48,413 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 15:57:48,413 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 15:57:48,668 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 15:57:48,917 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-lgr5.c.gcp-upstream.internal';"
2026-08-08 15:57:49,135 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 15:57:49,135 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 15:57:49,390 [I] DB_PATCHES have already been applied
I20260808 15:57:49.395931 19828 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-admin:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskeiRfxd/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 15:57:49.395993 19828 mini_ranger.cc:193] Using host: 127.19.93.20
I20260808 15:57:49.400317 19828 mini_ranger.cc:227] Ranger admin URL: http://127.19.93.20:39857
Aug 08, 2026 3:57:49 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 3:57:49 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 3:57:49 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 3:57:49 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 3:57:49 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 3:57:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 3:57:50 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 15:57:50.648633 19828 mini_ranger.cc:160] Time spent starting Ranger: real 8.406s user 0.006s sys 0.006s
Aug 08, 2026 3:58:10 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 3:58:10 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 3:58:10 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 3:58:10 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 3:58:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 3:58:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 3:58:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 3:58:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 3:58:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 3:58:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 3:58:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 3:58:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 3:58:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 3:58:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 3:58:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 3:58:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 3:58:10 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 3:58:11 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 15:58:12.284763 19828 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.19.93.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.19.93.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.19.93.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/rangerkms_127.19.93.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.19.93.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/rangerkms_127.19.93.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.93.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.19.93.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.93.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/HTTP_127.19.93.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.93.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/HTTP_127.19.93.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 15:58:12 dist-test-slave-lgr5 krb5kdc[5136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204692, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 15:58:12.367492 19828 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 15:58:12.377311 19828 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 15:58:13.125154 19828 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 15:58:13.125243 19828 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-kms
I20260808 15:58:13.125334 19828 mini_ranger_kms.cc:227] Using postgres at 127.19.93.20:41173
2026-08-08 15:58:13,340 [I] DB FLAVOR :POSTGRES
2026-08-08 15:58:13,340 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 15:58:13,340 [I] Checking connection
2026-08-08 15:58:13,340 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 15:58:13,578 [I] connection success
2026-08-08 15:58:13,579 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 15:58:13,579 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 15:58:13,579 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 15:58:13,803 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 15:58:13,803 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 15:58:13,803 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 15:58:13,803 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41173/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 15:58:14,083 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 15:58:14.553469 19828 mini_ranger_kms.cc:310] Created kms service
I20260808 15:58:14.741321 19828 mini_ranger_kms.cc:326] Created kudu user
I20260808 15:58:14.784319 19828 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 15:58:14 dist-test-slave-lgr5 krb5kdc[5136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204692, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
I20260808 15:58:15.167747 19828 mini_ranger_kms.cc:384] Added ranger policy
I20260808 15:58:15.167908 19828 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-kms:/tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 15:58:15.167930 19828 mini_ranger_kms.cc:240] Using host: 127.19.93.20
I20260808 15:58:15.173233 19828 mini_ranger_kms.cc:276] Ranger KMS PID: 5805
I20260808 15:58:15.173362 19828 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.19.93.20:49751
Aug 08, 2026 3:58:16 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 3:58:16 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 3:58:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 3:58:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 3:58:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 3:58:16 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 15:58:17 dist-test-slave-lgr5 krb5kdc[5136](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786204697, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.93.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:58:17.711890 19828 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.344s user 0.018s sys 0.181s
I20260808 15:58:17.712014 19828 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 15:58:17.712134 19828 mini_ranger_kms.cc:401] 127.19.93.20:49751/kms/v1/keys
Aug 08 15:58:18 dist-test-slave-lgr5 krb5kdc[5136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204697, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.93.20@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
Aug 08 15:58:18 dist-test-slave-lgr5 krb5kdc[5136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204697, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.93.20@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
Aug 08 15:58:20 dist-test-slave-lgr5 krb5kdc[5136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:58:20.680877 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:38043
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:37039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:38043
--ranger_config_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.93.20:49751/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:58:20.791292 5885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:58:20.791527 5885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:58:20.791589 5885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:58:20.795498 5885 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:58:20.795558 5885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:58:20.795590 5885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:58:20.795617 5885 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:58:20.795651 5885 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:58:20.800828 5885 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:37039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/wal
--ranger_kms_url=127.19.93.20:49751/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:38043
--ranger_config_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:38043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:58:20.801718 5885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:58:20.802646 5885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:58:20.810530 5899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:58:20.810564 5895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:58:20.810662 5885 server_base.cc:1034] running on GCE node
W20260808 15:58:20.810583 5896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:58:20.811309 5885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:58:20.812326 5885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:58:20.813478 5885 hybrid_clock.cc:648] HybridClock initialized: now 1786204700813456 us; error 34 us; skew 500 ppm
Aug 08 15:58:20 dist-test-slave-lgr5 krb5kdc[5136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204700, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:58:20.818907 5885 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:58:20.819664 5885 webserver.cc:460] Webserver started at http://127.19.93.62:39195/ using document root <none> and password file <none>
I20260808 15:58:20.820165 5885 fs_manager.cc:359] Metadata directory not provided
I20260808 15:58:20.820222 5885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:58:20.820381 5885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 15:58:20 dist-test-slave-lgr5 krb5kdc[5136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204700, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
I20260808 15:58:20.875202 5885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "678fea102795408785d06aa8ded4a1ac"
format_stamp: "Formatted at 2026-08-08 15:58:20 on dist-test-slave-lgr5"
server_key: "9292bc70bd9299ebd47b8e12096f25e8"
server_key_iv: "146f0f7f103c7cf02b76748c75b20fdb"
server_key_version: "kuduclusterkey@0"
I20260808 15:58:20.875941 5885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "678fea102795408785d06aa8ded4a1ac"
format_stamp: "Formatted at 2026-08-08 15:58:20 on dist-test-slave-lgr5"
server_key: "9292bc70bd9299ebd47b8e12096f25e8"
server_key_iv: "146f0f7f103c7cf02b76748c75b20fdb"
server_key_version: "kuduclusterkey@0"
I20260808 15:58:20.880798 5885 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 15:58:20.893869 5912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:58:20.895154 5885 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:58:20.895277 5885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "678fea102795408785d06aa8ded4a1ac"
format_stamp: "Formatted at 2026-08-08 15:58:20 on dist-test-slave-lgr5"
server_key: "9292bc70bd9299ebd47b8e12096f25e8"
server_key_iv: "146f0f7f103c7cf02b76748c75b20fdb"
server_key_version: "kuduclusterkey@0"
I20260808 15:58:20.895394 5885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:58:20.911548 5885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:58:20.914222 5885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:58:20.914392 5885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:58:20.922024 5885 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:38043
I20260808 15:58:20.922041 6003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:38043 every 8 connection(s)
I20260808 15:58:20.923015 5885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:58:20.925787 6004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:58:20.927830 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 5885
I20260808 15:58:20.927965 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:58:20.928324 19828 external_mini_cluster.cc:1428] Setting key b8b8965a97b8b3c1fe51a43823450fc2
I20260808 15:58:20.931813 6004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac: Bootstrap starting.
I20260808 15:58:20.934293 6004 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac: Neither blocks nor log segments found. Creating new log.
I20260808 15:58:20.934959 6004 log.cc:824] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac: Log is configured to *not* fsync() on all Append() calls
I20260808 15:58:20.937172 6004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac: No bootstrap required, opened a new log
Aug 08 15:58:20 dist-test-slave-lgr5 krb5kdc[5136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:58:20.941759 6004 raft_consensus.cc:348] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678fea102795408785d06aa8ded4a1ac" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38043 } }
I20260808 15:58:20.942029 6004 raft_consensus.cc:374] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:58:20.942147 6004 raft_consensus.cc:729] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 678fea102795408785d06aa8ded4a1ac, State: Initialized, Role: FOLLOWER
I20260808 15:58:20.942355 6008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:20.929778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56940 (local address 127.19.93.62:38043)
0808 15:58:20.930227 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0808 15:58:20.930245 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 15:58:20.930285 (+ 40us) server_negotiation.cc:407] Connection header received
0808 15:58:20.931064 (+ 779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:58:20.931088 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:58:20.931464 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:58:20.931794 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:58:20.932670 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:20.934121 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:20.935315 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:20.935880 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:20.936020 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:20.938267 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:58:20.938273 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:58:20.938285 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:58:20.938310 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:58:20.939704 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:58:20.940121 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:58:20.940127 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:58:20.940132 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:58:20.940233 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:58:20.940490 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:58:20.940493 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:58:20.940495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:58:20.940839 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:58:20.941034 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 15:58:20.941352 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 15:58:20.941615 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":142,"threads_started":1}
I20260808 15:58:20.942651 6004 consensus_queue.cc:260] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678fea102795408785d06aa8ded4a1ac" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38043 } }
I20260808 15:58:20.942849 6004 raft_consensus.cc:388] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:58:20.942945 6004 raft_consensus.cc:482] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:58:20.943046 6004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:58:20.944064 6004 raft_consensus.cc:504] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678fea102795408785d06aa8ded4a1ac" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38043 } }
I20260808 15:58:20.944438 6004 leader_election.cc:302] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 678fea102795408785d06aa8ded4a1ac; no voters:
I20260808 15:58:20.944833 6004 leader_election.cc:288] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:58:20.944957 6011 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:58:20.945199 6011 raft_consensus.cc:686] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [term 1 LEADER]: Becoming Leader. State: Replica: 678fea102795408785d06aa8ded4a1ac, State: Running, Role: LEADER
I20260808 15:58:20.945523 6011 consensus_queue.cc:237] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678fea102795408785d06aa8ded4a1ac" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38043 } }
I20260808 15:58:20.946048 6004 sys_catalog.cc:564] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:58:20.946972 6014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 678fea102795408785d06aa8ded4a1ac. Latest consensus state: current_term: 1 leader_uuid: "678fea102795408785d06aa8ded4a1ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678fea102795408785d06aa8ded4a1ac" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38043 } } }
I20260808 15:58:20.947086 6014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [sys.catalog]: This master's current role is: LEADER
I20260808 15:58:20.947414 6013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "678fea102795408785d06aa8ded4a1ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678fea102795408785d06aa8ded4a1ac" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38043 } } }
I20260808 15:58:20.947490 6013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac [sys.catalog]: This master's current role is: LEADER
I20260808 15:58:20.948287 6025 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:58:20.948550 6004 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 15:58:20.951344 6025 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:58:20.961925 6025 catalog_manager.cc:1347] Generated new cluster ID: 63fa6a91689e4598a10b0b02907322ce
I20260808 15:58:20.962004 6025 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:58:20.979112 6025 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:58:20.980049 6025 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:58:20.994524 6025 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac: Generated new TSK 0
I20260808 15:58:20.995182 6025 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 15:58:21.655478 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.93.20:49751/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:38043
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:37039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:58:21.780157 6070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:58:21.780404 6070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:58:21.780463 6070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:58:21.784710 6070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:58:21.784775 6070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:58:21.784857 6070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:58:21.792217 6070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:37039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.19.93.20:49751/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:38043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:58:21.793556 6070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:58:21.794804 6070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:58:21.805752 6087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:58:21.805809 6081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:58:21.805840 6082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:58:21.806005 6070 server_base.cc:1034] running on GCE node
I20260808 15:58:21.806488 6070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:58:21.807104 6070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:58:21.808260 6070 hybrid_clock.cc:648] HybridClock initialized: now 1786204701808228 us; error 51 us; skew 500 ppm
Aug 08 15:58:21 dist-test-slave-lgr5 krb5kdc[5136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204701, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:58:21.811743 6070 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:58:21.812831 6070 webserver.cc:460] Webserver started at http://127.19.93.1:36801/ using document root <none> and password file <none>
I20260808 15:58:21.813531 6070 fs_manager.cc:359] Metadata directory not provided
I20260808 15:58:21.813629 6070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:58:21.813925 6070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 15:58:21 dist-test-slave-lgr5 krb5kdc[5136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204701, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
I20260808 15:58:21.832289 6070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "a516e83bf54e4db385b50892ad763796"
format_stamp: "Formatted at 2026-08-08 15:58:21 on dist-test-slave-lgr5"
server_key: "7fb5636a0c0cddf5d76aee8909bf3575"
server_key_iv: "4881f7e05acc7c2aba19aa2417d26e3a"
server_key_version: "kuduclusterkey@0"
I20260808 15:58:21.833206 6070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "a516e83bf54e4db385b50892ad763796"
format_stamp: "Formatted at 2026-08-08 15:58:21 on dist-test-slave-lgr5"
server_key: "7fb5636a0c0cddf5d76aee8909bf3575"
server_key_iv: "4881f7e05acc7c2aba19aa2417d26e3a"
server_key_version: "kuduclusterkey@0"
I20260808 15:58:21.841711 6070 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.000s sys 0.004s
I20260808 15:58:21.857336 6099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:58:21.858877 6070 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:58:21.858999 6070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "a516e83bf54e4db385b50892ad763796"
format_stamp: "Formatted at 2026-08-08 15:58:21 on dist-test-slave-lgr5"
server_key: "7fb5636a0c0cddf5d76aee8909bf3575"
server_key_iv: "4881f7e05acc7c2aba19aa2417d26e3a"
server_key_version: "kuduclusterkey@0"
I20260808 15:58:21.859117 6070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:58:21.876925 6070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:58:21.880460 6070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:58:21.880687 6070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:58:21.881374 6070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:58:21.882418 6070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:58:21.882522 6070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:58:21.882644 6070 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:58:21.882720 6070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:58:21.895802 6070 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:41959
I20260808 15:58:21.896963 6070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:58:21.897775 6286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:41959 every 8 connection(s)
Aug 08 15:58:21 dist-test-slave-lgr5 krb5kdc[5136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204701, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:58:21.912335 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 6070
I20260808 15:58:21.912472 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:58:21.912825 19828 external_mini_cluster.cc:1428] Setting key 559f49402626f7dffd40c4a323951f5f
I20260808 15:58:21.915587 6292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:21.901624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:55675 (local address 127.19.93.62:38043)
0808 15:58:21.903257 (+ 1633us) server_negotiation.cc:206] Beginning negotiation
0808 15:58:21.903266 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:58:21.903285 (+ 19us) server_negotiation.cc:407] Connection header received
0808 15:58:21.903948 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:58:21.903951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:58:21.904013 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:58:21.904119 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:58:21.905607 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:21.906484 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:21.908170 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:21.908520 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:21.908623 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:21.911504 (+ 2881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:58:21.911509 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:58:21.911512 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:58:21.911538 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:58:21.913544 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:58:21.914123 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:58:21.914126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:58:21.914129 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:58:21.914205 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:58:21.914542 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:58:21.914546 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:58:21.914547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:58:21.914714 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:58:21.914796 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 15:58:21.915292 (+ 496us) server_negotiation.cc:299] Negotiation successful
0808 15:58:21.915414 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1549,"thread_start_us":115,"threads_started":1}
I20260808 15:58:21.916452 6291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:21.900433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:38043 (local address 127.19.93.1:55675)
0808 15:58:21.902541 (+ 2108us) negotiation.cc:107] Waiting for socket to connect
0808 15:58:21.902603 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 15:58:21.903742 (+ 1139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:58:21.904439 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:58:21.904448 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:58:21.904777 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:58:21.905432 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:58:21.905452 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:58:21.906635 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:58:21.906639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:58:21.908005 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:58:21.908018 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:58:21.908796 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:58:21.908800 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:58:21.909015 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:21.909646 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:58:21.909665 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:58:21.911313 (+ 1648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:58:21.913674 (+ 2361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:58:21.913679 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:58:21.913692 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:58:21.914010 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:58:21.914305 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:58:21.914308 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:58:21.914310 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:58:21.914451 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:58:21.914815 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:58:21.914822 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:58:21.915070 (+ 248us) client_negotiation.cc:769] Sending connection context
0808 15:58:21.915230 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 15:58:21.915524 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1860,"thread_start_us":143,"threads_started":1}
I20260808 15:58:21.917722 6288 heartbeater.cc:347] Connected to a master server at 127.19.93.62:38043
I20260808 15:58:21.917956 6288 heartbeater.cc:464] Registering TS with master...
I20260808 15:58:21.918462 6288 heartbeater.cc:511] Master 127.19.93.62:38043 requested a full tablet report, sending...
I20260808 15:58:21.920236 5936 ts_manager.cc:194] Registered new tserver with Master: a516e83bf54e4db385b50892ad763796 (127.19.93.1:41959)
I20260808 15:58:21.921789 5936 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:55675
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 15:58:21.961346 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.93.20:49751/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:38043
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:37039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:58:21 dist-test-slave-lgr5 krb5kdc[5136](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786204701, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 15:58:22.113632 6300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:58:22.113962 6300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:58:22.114027 6300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:58:22.119904 6300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:58:22.120018 6300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:58:22.120150 6300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:58:22.127822 6300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:37039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.19.93.20:49751/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:38043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:58:22.129298 6300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:58:22.130645 6300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:58:22.142658 6310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:58:22.142949 6312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:58:22.143379 6316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:58:22.144382 6300 server_base.cc:1034] running on GCE node
I20260808 15:58:22.144850 6300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:58:22.145643 6300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:58:22.146873 6300 hybrid_clock.cc:648] HybridClock initialized: now 1786204702146850 us; error 39 us; skew 500 ppm
Aug 08 15:58:22 dist-test-slave-lgr5 krb5kdc[5136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204702, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:58:22.150592 6300 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:58:22.151609 6300 webserver.cc:460] Webserver started at http://127.19.93.2:43695/ using document root <none> and password file <none>
I20260808 15:58:22.152447 6300 fs_manager.cc:359] Metadata directory not provided
I20260808 15:58:22.152544 6300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:58:22.152842 6300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 15:58:22 dist-test-slave-lgr5 krb5kdc[5136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204702, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
I20260808 15:58:22.187170 6300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "e5acab941adb4d29a8e80d6f21369f50"
format_stamp: "Formatted at 2026-08-08 15:58:22 on dist-test-slave-lgr5"
server_key: "09c3a4fd417acb6ae143cc04bddbc94b"
server_key_iv: "7501afc6286b6e2b222ccddb9f0fadb6"
server_key_version: "kuduclusterkey@0"
I20260808 15:58:22.187959 6300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "e5acab941adb4d29a8e80d6f21369f50"
format_stamp: "Formatted at 2026-08-08 15:58:22 on dist-test-slave-lgr5"
server_key: "09c3a4fd417acb6ae143cc04bddbc94b"
server_key_iv: "7501afc6286b6e2b222ccddb9f0fadb6"
server_key_version: "kuduclusterkey@0"
I20260808 15:58:22.193117 6300 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 15:58:22.213125 6331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:58:22.214773 6300 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:58:22.214949 6300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "e5acab941adb4d29a8e80d6f21369f50"
format_stamp: "Formatted at 2026-08-08 15:58:22 on dist-test-slave-lgr5"
server_key: "09c3a4fd417acb6ae143cc04bddbc94b"
server_key_iv: "7501afc6286b6e2b222ccddb9f0fadb6"
server_key_version: "kuduclusterkey@0"
I20260808 15:58:22.215134 6300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:58:22.233446 6300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:58:22.237344 6300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:58:22.237541 6300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:58:22.238332 6300 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:58:22.239440 6300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:58:22.239550 6300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:58:22.239638 6300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:58:22.239683 6300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:58:22.250929 6300 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:32847
I20260808 15:58:22.252061 6300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:58:22.255882 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 6300
I20260808 15:58:22.256022 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:58:22.256417 19828 external_mini_cluster.cc:1428] Setting key 23e98ed76b50e140cb69e62e97f1e361
I20260808 15:58:22.256248 6504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:32847 every 8 connection(s)
Aug 08 15:58:22 dist-test-slave-lgr5 krb5kdc[5136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204702, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:58:22.278354 6292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:22.259720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:35843 (local address 127.19.93.62:38043)
0808 15:58:22.259856 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 15:58:22.259861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:58:22.260426 (+ 565us) server_negotiation.cc:407] Connection header received
0808 15:58:22.261654 (+ 1228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:58:22.261657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:58:22.261710 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:58:22.261763 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:58:22.263443 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.264238 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.266013 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.266334 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.266407 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:22.269464 (+ 3057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:58:22.269468 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:58:22.269471 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:58:22.269500 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:58:22.271182 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:58:22.276403 (+ 5221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:58:22.276407 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:58:22.276409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:58:22.276510 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:58:22.276977 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:58:22.276980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:58:22.276982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:58:22.277211 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:58:22.277293 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 15:58:22.278015 (+ 722us) server_negotiation.cc:299] Negotiation successful
0808 15:58:22.278167 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 15:58:22.280386 6508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:22.258632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:38043 (local address 127.19.93.2:35843)
0808 15:58:22.260277 (+ 1645us) negotiation.cc:107] Waiting for socket to connect
0808 15:58:22.260334 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 15:58:22.261410 (+ 1076us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:58:22.262202 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:58:22.262211 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:58:22.262569 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:58:22.263277 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:58:22.263298 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.264400 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.264404 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:58:22.265878 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:58:22.265891 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.266603 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.266607 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:58:22.266803 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:22.267503 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:58:22.267524 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:58:22.269280 (+ 1756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:58:22.271322 (+ 2042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:58:22.271328 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:58:22.271343 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:58:22.271673 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:58:22.276640 (+ 4967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:58:22.276643 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:58:22.276646 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:58:22.276859 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:58:22.277365 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:58:22.277372 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:58:22.277710 (+ 338us) client_negotiation.cc:769] Sending connection context
0808 15:58:22.278820 (+ 1110us) client_negotiation.cc:240] Negotiation successful
0808 15:58:22.279250 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1403,"thread_start_us":165,"threads_started":1}
I20260808 15:58:22.281939 6505 heartbeater.cc:347] Connected to a master server at 127.19.93.62:38043
I20260808 15:58:22.282186 6505 heartbeater.cc:464] Registering TS with master...
I20260808 15:58:22.282776 6505 heartbeater.cc:511] Master 127.19.93.62:38043 requested a full tablet report, sending...
I20260808 15:58:22.284058 5936 ts_manager.cc:194] Registered new tserver with Master: e5acab941adb4d29a8e80d6f21369f50 (127.19.93.2:32847)
I20260808 15:58:22.284860 5936 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:35843
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 15:58:22.316180 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.93.20:49751/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:38043
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:37039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:58:22 dist-test-slave-lgr5 krb5kdc[5136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204701, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
W20260808 15:58:22.483233 6512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:58:22.484004 6512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:58:22.484156 6512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:58:22.491070 6512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:58:22.491191 6512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:58:22.491496 6512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:58:22.501085 6512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:37039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.19.93.20:49751/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:38043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:58:22.502446 6512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:58:22.503767 6512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:58:22.516405 6526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:58:22.516381 6529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:58:22.516957 6531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:58:22.517933 6512 server_base.cc:1034] running on GCE node
I20260808 15:58:22.518530 6512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:58:22.519279 6512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:58:22.520459 6512 hybrid_clock.cc:648] HybridClock initialized: now 1786204702520392 us; error 77 us; skew 500 ppm
Aug 08 15:58:22 dist-test-slave-lgr5 krb5kdc[5136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204702, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:58:22.524041 6512 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:58:22.525137 6512 webserver.cc:460] Webserver started at http://127.19.93.3:43305/ using document root <none> and password file <none>
I20260808 15:58:22.525840 6512 fs_manager.cc:359] Metadata directory not provided
I20260808 15:58:22.525987 6512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:58:22.526263 6512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 15:58:22 dist-test-slave-lgr5 krb5kdc[5136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204702, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
I20260808 15:58:22.543785 6512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "3a1fe9e501ed457fb042c60875cdfd97"
format_stamp: "Formatted at 2026-08-08 15:58:22 on dist-test-slave-lgr5"
server_key: "b16d074ccbdb72c20a7b0e047f106f7c"
server_key_iv: "025f322965161c69b95f148ee4cf891d"
server_key_version: "kuduclusterkey@0"
I20260808 15:58:22.544821 6512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "3a1fe9e501ed457fb042c60875cdfd97"
format_stamp: "Formatted at 2026-08-08 15:58:22 on dist-test-slave-lgr5"
server_key: "b16d074ccbdb72c20a7b0e047f106f7c"
server_key_iv: "025f322965161c69b95f148ee4cf891d"
server_key_version: "kuduclusterkey@0"
I20260808 15:58:22.557505 6512 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.004s sys 0.000s
I20260808 15:58:22.596575 6543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:58:22.598496 6512 fs_manager.cc:725] Time spent opening block manager: real 0.019s user 0.000s sys 0.004s
I20260808 15:58:22.598639 6512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "3a1fe9e501ed457fb042c60875cdfd97"
format_stamp: "Formatted at 2026-08-08 15:58:22 on dist-test-slave-lgr5"
server_key: "b16d074ccbdb72c20a7b0e047f106f7c"
server_key_iv: "025f322965161c69b95f148ee4cf891d"
server_key_version: "kuduclusterkey@0"
I20260808 15:58:22.598779 6512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:58:22.623602 6512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:58:22.627135 6512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:58:22.627382 6512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:58:22.628121 6512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:58:22.629228 6512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:58:22.629329 6512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:58:22.629426 6512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:58:22.629474 6512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:58:22.639556 6512 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:42545
I20260808 15:58:22.640710 6512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:58:22.644114 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 6512
I20260808 15:58:22.644239 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:58:22.644582 19828 external_mini_cluster.cc:1428] Setting key 9b472d66e1f158e82051242e553a4556
I20260808 15:58:22.650871 6737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:42545 every 8 connection(s)
Aug 08 15:58:22 dist-test-slave-lgr5 krb5kdc[5136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204702, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:58:22.665035 6292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:22.652290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:39671 (local address 127.19.93.62:38043)
0808 15:58:22.652448 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 15:58:22.652452 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:58:22.652467 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:58:22.653237 (+ 770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:58:22.653241 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:58:22.653295 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:58:22.653365 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:58:22.654884 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.655720 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.657540 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.657878 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.657959 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:22.661023 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:58:22.661027 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:58:22.661030 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:58:22.661057 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:58:22.662678 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:58:22.663280 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:58:22.663283 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:58:22.663285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:58:22.663373 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:58:22.663761 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:58:22.663764 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:58:22.663766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:58:22.663986 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:58:22.664068 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 15:58:22.664750 (+ 682us) server_negotiation.cc:299] Negotiation successful
0808 15:58:22.664879 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 15:58:22.666749 6741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:22.649673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:38043 (local address 127.19.93.3:39671)
0808 15:58:22.652061 (+ 2388us) negotiation.cc:107] Waiting for socket to connect
0808 15:58:22.652139 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0808 15:58:22.653037 (+ 898us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:58:22.653656 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:58:22.653665 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:58:22.654024 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:58:22.654688 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:58:22.654710 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.655895 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.655898 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:58:22.657395 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:58:22.657407 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.658164 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.658168 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:58:22.658361 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:22.659057 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:58:22.659078 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:58:22.660823 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:58:22.662817 (+ 1994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:58:22.662822 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:58:22.662836 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:58:22.663167 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:58:22.663478 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:58:22.663481 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:58:22.663483 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:58:22.663651 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:58:22.664156 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:58:22.664162 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:58:22.664474 (+ 312us) client_negotiation.cc:769] Sending connection context
0808 15:58:22.665433 (+ 959us) client_negotiation.cc:240] Negotiation successful
0808 15:58:22.665744 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2164,"thread_start_us":163,"threads_started":1}
I20260808 15:58:22.668351 6739 heartbeater.cc:347] Connected to a master server at 127.19.93.62:38043
I20260808 15:58:22.668606 6739 heartbeater.cc:464] Registering TS with master...
I20260808 15:58:22.669201 6739 heartbeater.cc:511] Master 127.19.93.62:38043 requested a full tablet report, sending...
I20260808 15:58:22.670459 5936 ts_manager.cc:194] Registered new tserver with Master: 3a1fe9e501ed457fb042c60875cdfd97 (127.19.93.3:42545)
I20260808 15:58:22.671206 5936 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:39671
I20260808 15:58:22.681978 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:58:22.695744 6292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:22.684776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56956 (local address 127.19.93.62:38043)
0808 15:58:22.684919 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 15:58:22.684926 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:58:22.685579 (+ 653us) server_negotiation.cc:407] Connection header received
0808 15:58:22.685797 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:58:22.685801 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:58:22.685868 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:58:22.685926 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:58:22.687029 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.687830 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.689091 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.689422 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.689512 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:22.691580 (+ 2068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:58:22.691585 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:58:22.691588 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:58:22.691618 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:58:22.693494 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:58:22.694084 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:58:22.694088 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:58:22.694089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:58:22.694193 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:58:22.694572 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:58:22.694576 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:58:22.694578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:58:22.694843 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:58:22.694964 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 15:58:22.695425 (+ 461us) server_negotiation.cc:299] Negotiation successful
0808 15:58:22.695555 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:58:22.700121 5936 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56956:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:58:22.705153 5936 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:58:22.730985 6760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:22.722188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:42545 (local address 127.0.0.1:50020)
0808 15:58:22.723424 (+ 1236us) negotiation.cc:107] Waiting for socket to connect
0808 15:58:22.723434 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 15:58:22.723496 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:58:22.725242 (+ 1746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:58:22.725248 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:58:22.725273 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:58:22.725447 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:58:22.725456 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.727041 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.727045 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:58:22.728477 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:58:22.728489 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.730458 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.730462 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:58:22.730582 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:22.730627 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 15:58:22.730715 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 15:58:22.730836 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1184,"thread_start_us":84,"threads_started":1}
I20260808 15:58:22.731637 6768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:22.719909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:41959 (local address 127.0.0.1:57626)
0808 15:58:22.723165 (+ 3256us) negotiation.cc:107] Waiting for socket to connect
0808 15:58:22.723177 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:58:22.723255 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:58:22.727441 (+ 4186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:58:22.727444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:58:22.727464 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:58:22.727566 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:58:22.727572 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.729077 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.729081 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:58:22.730205 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:58:22.730217 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.731283 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.731287 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:58:22.731386 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:22.731411 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 15:58:22.731456 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 15:58:22.731516 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3193,"thread_start_us":98,"threads_started":1}
I20260808 15:58:22.732052 6769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:22.722330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50020 (local address 127.19.93.3:42545)
0808 15:58:22.723795 (+ 1465us) server_negotiation.cc:206] Beginning negotiation
0808 15:58:22.723807 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:58:22.724573 (+ 766us) server_negotiation.cc:407] Connection header received
0808 15:58:22.724670 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:58:22.724676 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:58:22.725056 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:58:22.725608 (+ 552us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:58:22.725746 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.726904 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.729417 (+ 2513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.730299 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.731608 (+ 1309us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:22.731763 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 15:58:22.731819 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 15:58:22.731910 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1355,"thread_start_us":124,"threads_started":1}
I20260808 15:58:22.732501 6764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:22.720354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57626 (local address 127.19.93.1:41959)
0808 15:58:22.726982 (+ 6628us) server_negotiation.cc:206] Beginning negotiation
0808 15:58:22.726989 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:58:22.727013 (+ 24us) server_negotiation.cc:407] Connection header received
0808 15:58:22.727087 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:58:22.727092 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:58:22.727265 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:58:22.727710 (+ 445us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:58:22.727841 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.728946 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.730367 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.731148 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.732067 (+ 919us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:22.732230 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 15:58:22.732280 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 15:58:22.732367 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6518,"thread_start_us":122,"threads_started":1}
I20260808 15:58:22.735451 6637 tablet_service.cc:1467] Processing CreateTablet for tablet 4f31e1e35f6b4483a17ca7fda5d9f340 (DEFAULT_TABLE table=test-table [id=4fc3b9ada4a74a2bb3cffdef79d3f805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:58:22.735445 6173 tablet_service.cc:1467] Processing CreateTablet for tablet 4f31e1e35f6b4483a17ca7fda5d9f340 (DEFAULT_TABLE table=test-table [id=4fc3b9ada4a74a2bb3cffdef79d3f805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:58:22.736594 6637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f31e1e35f6b4483a17ca7fda5d9f340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:58:22.736594 6173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f31e1e35f6b4483a17ca7fda5d9f340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:58:22.736871 6763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:22.718030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:32847 (local address 127.0.0.1:39972)
0808 15:58:22.722753 (+ 4723us) negotiation.cc:107] Waiting for socket to connect
0808 15:58:22.722803 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 15:58:22.722937 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:58:22.732753 (+ 9816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:58:22.732756 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:58:22.732776 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:58:22.732868 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:58:22.732874 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.734327 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.734330 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:58:22.735446 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:58:22.735459 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.736518 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.736521 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:58:22.736615 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:22.736640 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 15:58:22.736692 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 15:58:22.736752 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4544,"thread_start_us":95,"threads_started":1}
I20260808 15:58:22.737540 6762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:22.718152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39972 (local address 127.19.93.2:32847)
0808 15:58:22.732278 (+ 14126us) server_negotiation.cc:206] Beginning negotiation
0808 15:58:22.732296 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 15:58:22.732317 (+ 21us) server_negotiation.cc:407] Connection header received
0808 15:58:22.732402 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:58:22.732407 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:58:22.732592 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:58:22.733015 (+ 423us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:58:22.733150 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.734194 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.735618 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.736381 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.737127 (+ 746us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:22.737261 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 15:58:22.737309 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 15:58:22.737403 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14016,"thread_start_us":90,"threads_started":1}
I20260808 15:58:22.740016 6407 tablet_service.cc:1467] Processing CreateTablet for tablet 4f31e1e35f6b4483a17ca7fda5d9f340 (DEFAULT_TABLE table=test-table [id=4fc3b9ada4a74a2bb3cffdef79d3f805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:58:22.740986 6407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f31e1e35f6b4483a17ca7fda5d9f340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:58:22.746297 6771 tablet_bootstrap.cc:492] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97: Bootstrap starting.
I20260808 15:58:22.746701 6770 tablet_bootstrap.cc:492] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796: Bootstrap starting.
I20260808 15:58:22.749128 6770 tablet_bootstrap.cc:654] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796: Neither blocks nor log segments found. Creating new log.
I20260808 15:58:22.752545 6771 tablet_bootstrap.cc:654] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97: Neither blocks nor log segments found. Creating new log.
I20260808 15:58:22.753468 6770 log.cc:824] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796: Log is configured to *not* fsync() on all Append() calls
I20260808 15:58:22.754323 6771 log.cc:824] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97: Log is configured to *not* fsync() on all Append() calls
I20260808 15:58:22.758088 6770 tablet_bootstrap.cc:492] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796: No bootstrap required, opened a new log
I20260808 15:58:22.758370 6770 ts_tablet_manager.cc:1397] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20260808 15:58:22.760445 6774 tablet_bootstrap.cc:492] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50: Bootstrap starting.
I20260808 15:58:22.763152 6774 tablet_bootstrap.cc:654] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50: Neither blocks nor log segments found. Creating new log.
I20260808 15:58:22.763175 6770 raft_consensus.cc:348] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5acab941adb4d29a8e80d6f21369f50" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32847 } } peers { permanent_uuid: "a516e83bf54e4db385b50892ad763796" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 41959 } } peers { permanent_uuid: "3a1fe9e501ed457fb042c60875cdfd97" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42545 } }
I20260808 15:58:22.764026 6774 log.cc:824] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50: Log is configured to *not* fsync() on all Append() calls
I20260808 15:58:22.764966 6771 tablet_bootstrap.cc:492] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97: No bootstrap required, opened a new log
I20260808 15:58:22.765990 6771 ts_tablet_manager.cc:1397] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.000s
I20260808 15:58:22.770100 6771 raft_consensus.cc:348] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5acab941adb4d29a8e80d6f21369f50" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32847 } } peers { permanent_uuid: "a516e83bf54e4db385b50892ad763796" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 41959 } } peers { permanent_uuid: "3a1fe9e501ed457fb042c60875cdfd97" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42545 } }
I20260808 15:58:22.770440 6771 raft_consensus.cc:374] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:58:22.770540 6771 raft_consensus.cc:729] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a1fe9e501ed457fb042c60875cdfd97, State: Initialized, Role: FOLLOWER
I20260808 15:58:22.771107 6771 consensus_queue.cc:260] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5acab941adb4d29a8e80d6f21369f50" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32847 } } peers { permanent_uuid: "a516e83bf54e4db385b50892ad763796" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 41959 } } peers { permanent_uuid: "3a1fe9e501ed457fb042c60875cdfd97" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42545 } }
I20260808 15:58:22.771410 6770 raft_consensus.cc:374] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:58:22.771513 6770 raft_consensus.cc:729] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a516e83bf54e4db385b50892ad763796, State: Initialized, Role: FOLLOWER
I20260808 15:58:22.772672 6771 ts_tablet_manager.cc:1428] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260808 15:58:22.773011 6770 consensus_queue.cc:260] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5acab941adb4d29a8e80d6f21369f50" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32847 } } peers { permanent_uuid: "a516e83bf54e4db385b50892ad763796" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 41959 } } peers { permanent_uuid: "3a1fe9e501ed457fb042c60875cdfd97" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42545 } }
I20260808 15:58:22.773916 6774 tablet_bootstrap.cc:492] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50: No bootstrap required, opened a new log
I20260808 15:58:22.774065 6770 ts_tablet_manager.cc:1428] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260808 15:58:22.774170 6774 ts_tablet_manager.cc:1397] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260808 15:58:22.774497 6739 heartbeater.cc:503] Master 127.19.93.62:38043 was elected leader, sending a full tablet report...
I20260808 15:58:22.777017 6288 heartbeater.cc:503] Master 127.19.93.62:38043 was elected leader, sending a full tablet report...
I20260808 15:58:22.780611 6774 raft_consensus.cc:348] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5acab941adb4d29a8e80d6f21369f50" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32847 } } peers { permanent_uuid: "a516e83bf54e4db385b50892ad763796" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 41959 } } peers { permanent_uuid: "3a1fe9e501ed457fb042c60875cdfd97" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42545 } }
I20260808 15:58:22.781009 6774 raft_consensus.cc:374] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:58:22.781111 6774 raft_consensus.cc:729] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5acab941adb4d29a8e80d6f21369f50, State: Initialized, Role: FOLLOWER
I20260808 15:58:22.781608 6774 consensus_queue.cc:260] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5acab941adb4d29a8e80d6f21369f50" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32847 } } peers { permanent_uuid: "a516e83bf54e4db385b50892ad763796" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 41959 } } peers { permanent_uuid: "3a1fe9e501ed457fb042c60875cdfd97" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42545 } }
I20260808 15:58:22.782692 6774 ts_tablet_manager.cc:1428] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260808 15:58:22.782927 6505 heartbeater.cc:503] Master 127.19.93.62:38043 was elected leader, sending a full tablet report...
Aug 08 15:58:22 dist-test-slave-lgr5 krb5kdc[5136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204701, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
W20260808 15:58:22.902993 6740 tablet.cc:2369] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:58:22.903898 6289 tablet.cc:2369] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:58:22.962533 6780 raft_consensus.cc:482] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:58:22.962759 6780 raft_consensus.cc:504] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5acab941adb4d29a8e80d6f21369f50" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32847 } } peers { permanent_uuid: "a516e83bf54e4db385b50892ad763796" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 41959 } } peers { permanent_uuid: "3a1fe9e501ed457fb042c60875cdfd97" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42545 } }
I20260808 15:58:22.964147 6780 leader_election.cc:288] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5acab941adb4d29a8e80d6f21369f50 (127.19.93.2:32847), 3a1fe9e501ed457fb042c60875cdfd97 (127.19.93.3:42545)
I20260808 15:58:22.970512 6769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:22.965160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:53405 (local address 127.19.93.3:42545)
0808 15:58:22.965303 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 15:58:22.965309 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:58:22.966160 (+ 851us) server_negotiation.cc:407] Connection header received
0808 15:58:22.966256 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:58:22.966259 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:58:22.966314 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:58:22.966402 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:58:22.966691 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.967492 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.969225 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.969831 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.969923 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:22.969990 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 15:58:22.970307 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 15:58:22.970382 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:58:22.971145 6788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:22.965006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:42545 (local address 127.19.93.1:53405)
0808 15:58:22.966076 (+ 1070us) negotiation.cc:107] Waiting for socket to connect
0808 15:58:22.966089 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:58:22.966171 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:58:22.966426 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:58:22.966429 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:58:22.966446 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:58:22.966549 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:58:22.966554 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.967664 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.967667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:58:22.969073 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:58:22.969085 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.970085 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.970088 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:58:22.970179 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:22.970199 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 15:58:22.970917 (+ 718us) client_negotiation.cc:240] Negotiation successful
0808 15:58:22.971001 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1009,"thread_start_us":106,"threads_started":1}
I20260808 15:58:22.971937 6670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f31e1e35f6b4483a17ca7fda5d9f340" candidate_uuid: "a516e83bf54e4db385b50892ad763796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a1fe9e501ed457fb042c60875cdfd97" is_pre_election: true
I20260808 15:58:22.972280 6670 raft_consensus.cc:2454] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a516e83bf54e4db385b50892ad763796 in term 0.
I20260808 15:58:22.972926 6103 leader_election.cc:302] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a1fe9e501ed457fb042c60875cdfd97, a516e83bf54e4db385b50892ad763796; no voters:
I20260808 15:58:22.973225 6780 raft_consensus.cc:2781] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:58:22.973292 6780 raft_consensus.cc:482] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:58:22.973328 6780 raft_consensus.cc:3037] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:58:22.974700 6780 raft_consensus.cc:504] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5acab941adb4d29a8e80d6f21369f50" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32847 } } peers { permanent_uuid: "a516e83bf54e4db385b50892ad763796" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 41959 } } peers { permanent_uuid: "3a1fe9e501ed457fb042c60875cdfd97" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42545 } }
I20260808 15:58:22.975112 6780 leader_election.cc:288] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [CANDIDATE]: Term 1 election: Requested vote from peers e5acab941adb4d29a8e80d6f21369f50 (127.19.93.2:32847), 3a1fe9e501ed457fb042c60875cdfd97 (127.19.93.3:42545)
I20260808 15:58:22.975899 6670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f31e1e35f6b4483a17ca7fda5d9f340" candidate_uuid: "a516e83bf54e4db385b50892ad763796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a1fe9e501ed457fb042c60875cdfd97"
I20260808 15:58:22.976022 6670 raft_consensus.cc:3037] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:58:22.977408 6670 raft_consensus.cc:2454] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a516e83bf54e4db385b50892ad763796 in term 1.
I20260808 15:58:22.977799 6103 leader_election.cc:302] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a1fe9e501ed457fb042c60875cdfd97, a516e83bf54e4db385b50892ad763796; no voters:
I20260808 15:58:22.978034 6780 raft_consensus.cc:2781] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:58:22.978253 6780 raft_consensus.cc:686] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [term 1 LEADER]: Becoming Leader. State: Replica: a516e83bf54e4db385b50892ad763796, State: Running, Role: LEADER
I20260808 15:58:22.978611 6780 consensus_queue.cc:237] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5acab941adb4d29a8e80d6f21369f50" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32847 } } peers { permanent_uuid: "a516e83bf54e4db385b50892ad763796" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 41959 } } peers { permanent_uuid: "3a1fe9e501ed457fb042c60875cdfd97" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42545 } }
I20260808 15:58:22.979817 6762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:22.965517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:59629 (local address 127.19.93.2:32847)
0808 15:58:22.965634 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 15:58:22.965639 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:58:22.965811 (+ 172us) server_negotiation.cc:407] Connection header received
0808 15:58:22.965969 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:58:22.965973 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:58:22.966025 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:58:22.966095 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:58:22.976479 (+ 10384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.977183 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.978562 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.979117 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.979196 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:22.979261 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 15:58:22.979616 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 15:58:22.979699 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 15:58:22.980195 6787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:22.964582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:32847 (local address 127.19.93.1:59629)
0808 15:58:22.965735 (+ 1153us) negotiation.cc:107] Waiting for socket to connect
0808 15:58:22.965748 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:58:22.965876 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:58:22.976147 (+ 10271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:58:22.976150 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:58:22.976174 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:58:22.976299 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:58:22.976306 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.977340 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.977343 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:58:22.978417 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:58:22.978427 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:58:22.979357 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:58:22.979374 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:58:22.979472 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:22.979496 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:58:22.979968 (+ 472us) client_negotiation.cc:240] Negotiation successful
0808 15:58:22.980042 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1084,"thread_start_us":112,"threads_started":1}
I20260808 15:58:22.980990 6433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f31e1e35f6b4483a17ca7fda5d9f340" candidate_uuid: "a516e83bf54e4db385b50892ad763796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5acab941adb4d29a8e80d6f21369f50" is_pre_election: true
I20260808 15:58:22.981273 6433 raft_consensus.cc:2454] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a516e83bf54e4db385b50892ad763796 in term 0.
I20260808 15:58:22.981573 6432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f31e1e35f6b4483a17ca7fda5d9f340" candidate_uuid: "a516e83bf54e4db385b50892ad763796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5acab941adb4d29a8e80d6f21369f50"
I20260808 15:58:22.981666 6432 raft_consensus.cc:3037] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:58:22.982964 6432 raft_consensus.cc:2454] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a516e83bf54e4db385b50892ad763796 in term 1.
I20260808 15:58:22.985848 5939 catalog_manager.cc:5495] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 reported cstate change: term changed from 0 to 1, leader changed from <none> to a516e83bf54e4db385b50892ad763796 (127.19.93.1). New cstate: current_term: 1 leader_uuid: "a516e83bf54e4db385b50892ad763796" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5acab941adb4d29a8e80d6f21369f50" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a516e83bf54e4db385b50892ad763796" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 41959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a1fe9e501ed457fb042c60875cdfd97" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42545 } health_report { overall_health: UNKNOWN } } }
W20260808 15:58:23.012620 6507 tablet.cc:2369] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:58:23.032923 6764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:23.027660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57634 (local address 127.19.93.1:41959)
0808 15:58:23.027777 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 15:58:23.027781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:58:23.027970 (+ 189us) server_negotiation.cc:407] Connection header received
0808 15:58:23.028069 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:58:23.028072 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:58:23.028178 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:58:23.028287 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:58:23.028693 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:23.029473 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:23.030688 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:58:23.031022 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:58:23.031120 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:58:23.031564 (+ 444us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:58:23.032143 (+ 579us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:58:23.032261 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 15:58:23.032689 (+ 428us) server_negotiation.cc:299] Negotiation successful
0808 15:58:23.032755 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 15:58:23.040570 6670 raft_consensus.cc:1261] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97 [term 1 FOLLOWER]: Refusing update from remote peer a516e83bf54e4db385b50892ad763796: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:58:23.041457 6789 consensus_queue.cc:1035] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a1fe9e501ed457fb042c60875cdfd97" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 42545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:58:23.046202 6432 raft_consensus.cc:1261] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50 [term 1 FOLLOWER]: Refusing update from remote peer a516e83bf54e4db385b50892ad763796: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:58:23.046989 6789 consensus_queue.cc:1035] T 4f31e1e35f6b4483a17ca7fda5d9f340 P a516e83bf54e4db385b50892ad763796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5acab941adb4d29a8e80d6f21369f50" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:58:23.056006 6796 mvcc.cc:205] Tried to move back new op lower bound from 7316294463644704768 to 7316294463404077056. Current Snapshot: MvccSnapshot[applied={T|T < 7316294463644704768}]
I20260808 15:58:23.069450 6798 mvcc.cc:205] Tried to move back new op lower bound from 7316294463644704768 to 7316294463404077056. Current Snapshot: MvccSnapshot[applied={T|T < 7316294463644704768}]
I20260808 15:58:23.070703 5939 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:58:23.070869 5939 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:58:23.073501 5939 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 678fea102795408785d06aa8ded4a1ac: Sending DeleteTablet for 3 replicas of tablet 4f31e1e35f6b4483a17ca7fda5d9f340
I20260808 15:58:23.074295 6173 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f31e1e35f6b4483a17ca7fda5d9f340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:58:23 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:57626
I20260808 15:58:23.075110 6407 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f31e1e35f6b4483a17ca7fda5d9f340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:58:23 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:39972
I20260808 15:58:23.075340 6637 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f31e1e35f6b4483a17ca7fda5d9f340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:58:23 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:50020
I20260808 15:58:23.076027 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 6070
I20260808 15:58:23.084353 6809 tablet_replica.cc:330] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50: stopping tablet replica
I20260808 15:58:23.085597 6809 raft_consensus.cc:2229] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:58:23.085989 6809 raft_consensus.cc:2258] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:58:23.091327 6810 tablet_replica.cc:330] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97: stopping tablet replica
I20260808 15:58:23.091632 6810 raft_consensus.cc:2229] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:58:23.091952 6810 raft_consensus.cc:2258] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:58:23.092948 6809 ts_tablet_manager.cc:1905] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:58:23.093658 6810 ts_tablet_manager.cc:1905] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:58:23.096029 6809 ts_tablet_manager.cc:1918] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260808 15:58:23.099262 5917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:41959 (error 108)
I20260808 15:58:23.100142 6809 log.cc:1196] T 4f31e1e35f6b4483a17ca7fda5d9f340 P e5acab941adb4d29a8e80d6f21369f50: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/4f31e1e35f6b4483a17ca7fda5d9f340
I20260808 15:58:23.100265 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 6300
I20260808 15:58:23.111145 6810 ts_tablet_manager.cc:1918] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:58:23.111231 6810 log.cc:1196] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/4f31e1e35f6b4483a17ca7fda5d9f340
I20260808 15:58:23.111464 6810 ts_tablet_manager.cc:1939] T 4f31e1e35f6b4483a17ca7fda5d9f340 P 3a1fe9e501ed457fb042c60875cdfd97: Deleting consensus metadata
I20260808 15:58:23.191591 5917 catalog_manager.cc:4841] TS 3a1fe9e501ed457fb042c60875cdfd97 (127.19.93.3:42545): tablet 4f31e1e35f6b4483a17ca7fda5d9f340 (table test-table [id=4fc3b9ada4a74a2bb3cffdef79d3f805]) successfully deleted
I20260808 15:58:23.199082 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 6512
I20260808 15:58:23.199458 6763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:23.199067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:41959 (local address 127.0.0.1:57642)
0808 15:58:23.199275 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 15:58:23.199353 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:41959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
W20260808 15:58:23.200958 5917 catalog_manager.cc:4584] TS a516e83bf54e4db385b50892ad763796 (127.19.93.1:41959): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4f31e1e35f6b4483a17ca7fda5d9f340: Network error: Client connection negotiation failed: client connection to 127.19.93.1:41959: connect: Connection refused (error 111)
I20260808 15:58:23.201961 6763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:58:23.201644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:32847 (local address 127.0.0.1:39984)
0808 15:58:23.201824 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 15:58:23.201881 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.2:32847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260808 15:58:23.214114 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 5885
I20260808 15:58:23.229562 19828 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 15:58:23.574790 19828 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 15:58:23.574911 19828 mini_ranger.cc:66] Stopping Ranger...
I20260808 15:58:23.918236 19828 mini_ranger.cc:68] Stopped Ranger
2026-08-08 15:58:23.918 UTC [5190] LOG: received smart shutdown request
2026-08-08 15:58:23.921 UTC [5190] LOG: background worker "logical replication launcher" (PID 5205) exited with exit code 1
2026-08-08 15:58:23.922 UTC [5198] LOG: shutting down
2026-08-08 15:58:24.067 UTC [5190] LOG: database system is shut down
2026-08-08T15:58:24Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (46612 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:58:24 dist-test-slave-lgr5 krb5kdc[6831](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:58:24 dist-test-slave-lgr5 krb5kdc[6831](info): set up 2 sockets
Aug 08 15:58:24 dist-test-slave-lgr5 krb5kdc[6831](info): commencing operation
krb5kdc: starting...
W20260808 15:58:25.301265 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:58:25 dist-test-slave-lgr5 krb5kdc[6831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:58:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:58:25Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.19.93.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.19.93.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.19.93.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/rangeradmin_127.19.93.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.19.93.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/rangeradmin_127.19.93.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.19.93.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.19.93.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.19.93.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/rangerlookup_127.19.93.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.19.93.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/rangerlookup_127.19.93.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.93.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.19.93.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.93.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/HTTP_127.19.93.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.93.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/HTTP_127.19.93.20@KRBTEST.COM.keytab.
I20260808 15:58:25.455366 19828 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskeiRfxd/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/postgres -l logfile start
2026-08-08 15:58:27.692 UTC [6872] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 15:58:27.692 UTC [6872] LOG: listening on IPv4 address "127.19.93.20", port 41167
2026-08-08 15:58:27.695 UTC [6872] LOG: listening on Unix socket "/tmp/.s.PGSQL.41167"
2026-08-08 15:58:27.714 UTC [6876] LOG: database system was shut down at 2026-08-08 15:58:26 UTC
2026-08-08 15:58:27.718 UTC [6872] LOG: database system is ready to accept connections
I20260808 15:58:28.779906 19828 mini_postgres.cc:96] Postgres bound to 41167
2026-08-08 15:58:28.786 UTC [6891] FATAL: database "slave" does not exist
127.19.93.20:41167 - accepting connections
I20260808 15:58:28.787415 19828 mini_ranger.cc:161] Starting Ranger...
I20260808 15:58:28.801857 19828 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 15:58:29.218807 19828 mini_ranger.cc:87] Created ranger Postgres database
I20260808 15:58:29.218881 19828 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-admin
2026-08-08 15:58:29,504 [I] DB FLAVOR :POSTGRES
2026-08-08 15:58:29,505 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 15:58:29,505 [I] Checking connection..
2026-08-08 15:58:29,505 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 15:58:29,761 [I] Checking connection passed.
2026-08-08 15:58:29,762 [I] --------- Verifying version history table ---------
2026-08-08 15:58:29,762 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 15:58:30,001 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 15:58:30,001 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 15:58:30,241 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 15:58:30,241 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 15:58:30,241 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 15:58:30.460 UTC [7006] WARNING: there is no transaction in progress
2026-08-08 15:58:30,467 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 15:58:30,467 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 15:58:30,720 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 15:58:30,720 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 15:58:30,721 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 15:58:30,961 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 15:58:31,214 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-lgr5.c.gcp-upstream.internal','N') ;"
2026-08-08 15:58:31,429 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 15:58:31,665 [I] Table x_portal_user does not exist in database ranger
2026-08-08 15:58:31,665 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 15:58:31,934 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 15:58:31,934 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 15:58:32,199 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 15:58:32,449 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 15:58:32,450 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 15:58:33.347 UTC [7174] WARNING: there is no transaction in progress
2026-08-08 15:58:33.362 UTC [7174] WARNING: there is no transaction in progress
2026-08-08 15:58:33.376 UTC [7174] WARNING: there is no transaction in progress
2026-08-08 15:58:33.390 UTC [7174] WARNING: there is no transaction in progress
2026-08-08 15:58:33.404 UTC [7174] WARNING: there is no transaction in progress
2026-08-08 15:58:33.420 UTC [7174] WARNING: there is no transaction in progress
2026-08-08 15:58:33.472 UTC [7174] WARNING: there is no transaction in progress
2026-08-08 15:58:33.478 UTC [7174] WARNING: there is no transaction in progress
2026-08-08 15:58:33.491 UTC [7174] WARNING: there is no transaction in progress
2026-08-08 15:58:33.501 UTC [7174] WARNING: there is no transaction in progress
2026-08-08 15:58:33.510 UTC [7174] WARNING: there is no transaction in progress
2026-08-08 15:58:33.523 UTC [7174] WARNING: there is no transaction in progress
2026-08-08 15:58:33.531 UTC [7174] WARNING: there is no transaction in progress
2026-08-08 15:58:33.537 UTC [7174] WARNING: there is no transaction in progress
2026-08-08 15:58:33.542 UTC [7174] WARNING: there is no transaction in progress
2026-08-08 15:58:33.548 UTC [7174] WARNING: there is no transaction in progress
2026-08-08 15:58:34,111 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 15:58:34,111 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 15:58:34,360 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 15:58:34,360 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 15:58:34,611 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 15:58:34,611 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 15:58:34,841 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 15:58:34,841 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 15:58:35,091 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 15:58:35,322 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-lgr5.c.gcp-upstream.internal';"
2026-08-08 15:58:35,561 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 15:58:35,561 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 15:58:35,809 [I] DB_PATCHES have already been applied
I20260808 15:58:35.816255 19828 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-admin:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskeiRfxd/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 15:58:35.816323 19828 mini_ranger.cc:193] Using host: 127.19.93.20
I20260808 15:58:35.820756 19828 mini_ranger.cc:227] Ranger admin URL: http://127.19.93.20:36605
Aug 08, 2026 3:58:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 3:58:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 3:58:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 3:58:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 3:58:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 3:58:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 3:58:36 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 15:58:37.123042 19828 mini_ranger.cc:160] Time spent starting Ranger: real 8.336s user 0.000s sys 0.010s
Aug 08, 2026 3:58:55 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 3:58:55 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 3:58:55 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 3:58:55 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 3:58:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 3:58:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 3:58:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 3:58:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 3:58:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 3:58:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 3:58:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 3:58:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 3:58:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 3:58:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 3:58:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 3:58:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 3:58:55 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 3:58:56 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 15:58:56.637061 19828 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.19.93.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.19.93.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.19.93.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/rangerkms_127.19.93.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.19.93.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/rangerkms_127.19.93.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.93.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.19.93.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.93.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/HTTP_127.19.93.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.93.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/HTTP_127.19.93.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 15:58:56 dist-test-slave-lgr5 krb5kdc[6831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204736, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 15:58:56.711057 19828 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 15:58:56.719957 19828 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 15:58:57.432166 19828 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 15:58:57.432250 19828 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-kms
I20260808 15:58:57.432266 19828 mini_ranger_kms.cc:227] Using postgres at 127.19.93.20:41167
2026-08-08 15:58:57,591 [I] DB FLAVOR :POSTGRES
2026-08-08 15:58:57,591 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 15:58:57,592 [I] Checking connection
2026-08-08 15:58:57,592 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 15:58:57,821 [I] connection success
2026-08-08 15:58:57,822 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 15:58:57,822 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 15:58:57,822 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 15:58:58,068 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 15:58:58,068 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 15:58:58,068 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 15:58:58,068 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.93.20:41167/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 15:58:58,313 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 15:58:58.751751 19828 mini_ranger_kms.cc:310] Created kms service
I20260808 15:58:58.931068 19828 mini_ranger_kms.cc:326] Created kudu user
I20260808 15:58:58.975648 19828 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 15:58:58 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204736, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
I20260808 15:58:59.355278 19828 mini_ranger_kms.cc:384] Added ranger policy
I20260808 15:58:59.355537 19828 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-kms:/tmp/dist-test-taskeiRfxd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskeiRfxd/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 15:58:59.355566 19828 mini_ranger_kms.cc:240] Using host: 127.19.93.20
I20260808 15:58:59.360541 19828 mini_ranger_kms.cc:276] Ranger KMS PID: 7460
I20260808 15:58:59.360616 19828 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.19.93.20:34827
Aug 08, 2026 3:59:00 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 3:59:00 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 3:59:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 3:59:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 3:59:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 3:59:00 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 15:59:01 dist-test-slave-lgr5 krb5kdc[6831](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786204741, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.93.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:01.898964 19828 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.188s user 0.002s sys 0.141s
I20260808 15:59:01.899071 19828 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 15:59:01.899145 19828 mini_ranger_kms.cc:401] 127.19.93.20:34827/kms/v1/keys
Aug 08 15:59:01 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204741, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.93.20@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
Aug 08 15:59:02 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204741, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.93.20@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
Aug 08 15:59:04 dist-test-slave-lgr5 krb5kdc[6831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204744, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:59:04.492882 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:39975
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:39975
--ranger_config_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.93.20:34827/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:04.603225 7554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:04.603492 7554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:04.603554 7554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:04.607554 7554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:59:04.607618 7554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:04.607650 7554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:04.607686 7554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:59:04.607759 7554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:59:04.613067 7554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/wal
--ranger_kms_url=127.19.93.20:34827/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:39975
--ranger_config_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:39975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:04.614009 7554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:04.614969 7554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:04.623471 7564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:04.623622 7554 server_base.cc:1034] running on GCE node
W20260808 15:59:04.623485 7566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:04.623452 7568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:04.624472 7554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:04.625777 7554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:04.626961 7554 hybrid_clock.cc:648] HybridClock initialized: now 1786204744626937 us; error 34 us; skew 500 ppm
Aug 08 15:59:04 dist-test-slave-lgr5 krb5kdc[6831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204744, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:04.632844 7554 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:59:04.633903 7554 webserver.cc:460] Webserver started at http://127.19.93.62:36531/ using document root <none> and password file <none>
I20260808 15:59:04.634526 7554 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:04.634608 7554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:04.634824 7554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 15:59:04 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204744, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
I20260808 15:59:04.681207 7554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "ee47533923274d1b9ff7a5264af8bb3b"
format_stamp: "Formatted at 2026-08-08 15:59:04 on dist-test-slave-lgr5"
server_key: "db49e4a75e59e4623144232b036a752a"
server_key_iv: "aac07cc9983cde10a788475a7475da56"
server_key_version: "kuduclusterkey@0"
I20260808 15:59:04.681972 7554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "ee47533923274d1b9ff7a5264af8bb3b"
format_stamp: "Formatted at 2026-08-08 15:59:04 on dist-test-slave-lgr5"
server_key: "db49e4a75e59e4623144232b036a752a"
server_key_iv: "aac07cc9983cde10a788475a7475da56"
server_key_version: "kuduclusterkey@0"
I20260808 15:59:04.686842 7554 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 15:59:04.704145 7579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:04.705641 7554 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:59:04.705775 7554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "ee47533923274d1b9ff7a5264af8bb3b"
format_stamp: "Formatted at 2026-08-08 15:59:04 on dist-test-slave-lgr5"
server_key: "db49e4a75e59e4623144232b036a752a"
server_key_iv: "aac07cc9983cde10a788475a7475da56"
server_key_version: "kuduclusterkey@0"
I20260808 15:59:04.705893 7554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:04.742638 7554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:04.745287 7554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:04.745468 7554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:04.753489 7554 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:39975
I20260808 15:59:04.753521 7669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:39975 every 8 connection(s)
I20260808 15:59:04.754443 7554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:59:04.757197 7671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:04.759871 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 7554
I20260808 15:59:04.759986 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:59:04.760294 19828 external_mini_cluster.cc:1428] Setting key f163ce8d7473ce481b6e090129405f00
I20260808 15:59:04.763207 7671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b: Bootstrap starting.
I20260808 15:59:04.765790 7671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:04.766584 7671 log.cc:824] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:04.769212 7671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b: No bootstrap required, opened a new log
Aug 08 15:59:04 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204744, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:04.773033 7671 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee47533923274d1b9ff7a5264af8bb3b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39975 } }
I20260808 15:59:04.773341 7671 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:04.773402 7671 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee47533923274d1b9ff7a5264af8bb3b, State: Initialized, Role: FOLLOWER
I20260808 15:59:04.773824 7671 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee47533923274d1b9ff7a5264af8bb3b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39975 } }
I20260808 15:59:04.773990 7671 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:59:04.774106 7671 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:59:04.774211 7671 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:04.775242 7671 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee47533923274d1b9ff7a5264af8bb3b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39975 } }
I20260808 15:59:04.775604 7671 leader_election.cc:302] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee47533923274d1b9ff7a5264af8bb3b; no voters:
I20260808 15:59:04.775949 7671 leader_election.cc:288] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:59:04.776017 7674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:04.761698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55946 (local address 127.19.93.62:39975)
0808 15:59:04.762163 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:04.762184 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:04.762228 (+ 44us) server_negotiation.cc:407] Connection header received
0808 15:59:04.763047 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:04.763071 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:04.763457 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:04.763801 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:04.764656 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:04.766073 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:04.767287 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:04.767742 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:04.767875 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:04.770802 (+ 2927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:04.770809 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:04.770825 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:04.770855 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:04.772771 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:04.773291 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:04.773297 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:04.773303 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:04.773427 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:04.773846 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:04.773850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:04.773852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:04.774351 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:04.774568 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:04.774839 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 15:59:04.775124 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":138,"threads_started":1}
I20260808 15:59:04.776005 7677 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:59:04.776676 7677 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 1 LEADER]: Becoming Leader. State: Replica: ee47533923274d1b9ff7a5264af8bb3b, State: Running, Role: LEADER
I20260808 15:59:04.777037 7677 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee47533923274d1b9ff7a5264af8bb3b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39975 } }
I20260808 15:59:04.777300 7671 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:59:04.778273 7677 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee47533923274d1b9ff7a5264af8bb3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee47533923274d1b9ff7a5264af8bb3b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39975 } } }
I20260808 15:59:04.778477 7677 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:04.778740 7677 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee47533923274d1b9ff7a5264af8bb3b. Latest consensus state: current_term: 1 leader_uuid: "ee47533923274d1b9ff7a5264af8bb3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee47533923274d1b9ff7a5264af8bb3b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39975 } } }
I20260808 15:59:04.778852 7677 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:04.779134 7686 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:59:04.782747 7686 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:59:04.783855 7671 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 15:59:04.793406 7686 catalog_manager.cc:1347] Generated new cluster ID: 69bb8f7f0206466b98aca8385538616b
I20260808 15:59:04.793535 7686 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:59:04.800136 7686 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:59:04.801327 7686 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:59:04.811851 7686 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b: Generated new TSK 0
I20260808 15:59:04.812685 7686 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 15:59:05.594856 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.93.20:34827/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39975
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:05.760504 7731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:05.760876 7731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:05.760972 7731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:05.766647 7731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:05.766714 7731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:05.766795 7731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:59:05.773233 7731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.19.93.20:34827/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:05.774690 7731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:05.776052 7731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:05.786031 7742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:05.786285 7745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:05.786114 7748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:05.786465 7731 server_base.cc:1034] running on GCE node
I20260808 15:59:05.786823 7731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:05.787403 7731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:05.788578 7731 hybrid_clock.cc:648] HybridClock initialized: now 1786204745788552 us; error 36 us; skew 500 ppm
Aug 08 15:59:05 dist-test-slave-lgr5 krb5kdc[6831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204745, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:05.791144 7731 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:59:05.791994 7731 webserver.cc:460] Webserver started at http://127.19.93.1:44801/ using document root <none> and password file <none>
I20260808 15:59:05.792570 7731 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:05.792637 7731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:05.792848 7731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 15:59:05 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204745, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
I20260808 15:59:05.806730 7731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "70813ff08a8f4408aaa5147d75bc79a1"
format_stamp: "Formatted at 2026-08-08 15:59:05 on dist-test-slave-lgr5"
server_key: "b2ca758e74ec13391d9857911b5f9693"
server_key_iv: "b3cf4a64076dfff214f56cfa415bcd2e"
server_key_version: "kuduclusterkey@0"
I20260808 15:59:05.807289 7731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "70813ff08a8f4408aaa5147d75bc79a1"
format_stamp: "Formatted at 2026-08-08 15:59:05 on dist-test-slave-lgr5"
server_key: "b2ca758e74ec13391d9857911b5f9693"
server_key_iv: "b3cf4a64076dfff214f56cfa415bcd2e"
server_key_version: "kuduclusterkey@0"
I20260808 15:59:05.816433 7731 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.002s sys 0.004s
I20260808 15:59:05.832259 7758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:05.833909 7731 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:59:05.834035 7731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "70813ff08a8f4408aaa5147d75bc79a1"
format_stamp: "Formatted at 2026-08-08 15:59:05 on dist-test-slave-lgr5"
server_key: "b2ca758e74ec13391d9857911b5f9693"
server_key_iv: "b3cf4a64076dfff214f56cfa415bcd2e"
server_key_version: "kuduclusterkey@0"
I20260808 15:59:05.834163 7731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:05.856348 7731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:05.859519 7731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:05.859724 7731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:05.860448 7731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:05.861457 7731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:05.861562 7731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:05.861686 7731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:05.861769 7731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:05.875550 7731 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:37871
I20260808 15:59:05.879586 7731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:59:05.880936 7943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:37871 every 8 connection(s)
I20260808 15:59:05.883997 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 7731
I20260808 15:59:05.884127 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:59:05.884477 19828 external_mini_cluster.cc:1428] Setting key 98e05fa45ec6391337b27dbb3175bcb9
Aug 08 15:59:05 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204745, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:05.912521 7950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:05.884284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:47877 (local address 127.19.93.62:39975)
0808 15:59:05.896258 (+ 11974us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:05.896264 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:05.896280 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:59:05.896322 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:05.896325 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:05.896375 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:05.896464 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:05.898019 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:05.898893 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:05.900683 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:05.901059 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:05.901157 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:05.906784 (+ 5627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:05.906788 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:05.906791 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:05.906818 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:05.908765 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:05.909372 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:05.909376 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:05.909377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:05.909469 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:05.909895 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:05.909899 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:05.909900 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:05.910127 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:05.910222 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:05.912215 (+ 1993us) server_negotiation.cc:299] Negotiation successful
0808 15:59:05.912345 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11888,"thread_start_us":90,"threads_started":1}
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
I20260808 15:59:05.917872 7949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:05.883213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:39975 (local address 127.19.93.1:47877)
0808 15:59:05.888368 (+ 5155us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:05.888423 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:05.889423 (+ 1000us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:05.896780 (+ 7357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:05.896789 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:05.897158 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:05.897838 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:05.897860 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:05.899100 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:05.899104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:05.900540 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:05.900553 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:05.901332 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:05.901336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:05.901531 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:05.904231 (+ 2700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:05.904252 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:05.906592 (+ 2340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:05.908916 (+ 2324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:05.908921 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:05.908936 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:05.909251 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:05.909575 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:05.909578 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:05.909580 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:05.909764 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:05.910277 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:05.910285 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:05.910613 (+ 328us) client_negotiation.cc:769] Sending connection context
0808 15:59:05.910815 (+ 202us) client_negotiation.cc:240] Negotiation successful
0808 15:59:05.911157 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4924,"thread_start_us":127,"threads_started":1}
I20260808 15:59:05.920737 7947 heartbeater.cc:347] Connected to a master server at 127.19.93.62:39975
I20260808 15:59:05.921000 7947 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:05.921576 7947 heartbeater.cc:511] Master 127.19.93.62:39975 requested a full tablet report, sending...
I20260808 15:59:05.923341 7605 ts_manager.cc:194] Registered new tserver with Master: 70813ff08a8f4408aaa5147d75bc79a1 (127.19.93.1:37871)
I20260808 15:59:05.924976 7605 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:47877
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 15:59:05.948001 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.93.20:34827/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39975
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:59:05 dist-test-slave-lgr5 krb5kdc[6831](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786204745, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 15:59:06.110913 7956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:06.111238 7956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:06.111302 7956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:06.117273 7956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:06.117414 7956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:06.117544 7956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:59:06.125236 7956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.19.93.20:34827/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:06.126683 7956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:06.128012 7956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:06.140465 7966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:06.140882 7968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:06.141008 7971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:06.141332 7956 server_base.cc:1034] running on GCE node
I20260808 15:59:06.141772 7956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:06.142517 7956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:06.143699 7956 hybrid_clock.cc:648] HybridClock initialized: now 1786204746143678 us; error 34 us; skew 500 ppm
Aug 08 15:59:06 dist-test-slave-lgr5 krb5kdc[6831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204746, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:06.147303 7956 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:59:06.148414 7956 webserver.cc:460] Webserver started at http://127.19.93.2:38253/ using document root <none> and password file <none>
I20260808 15:59:06.149087 7956 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:06.149178 7956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:06.149477 7956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 15:59:06 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204746, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
I20260808 15:59:06.174399 7956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "3873697dac4e40aa92a427fe99c60f9b"
format_stamp: "Formatted at 2026-08-08 15:59:06 on dist-test-slave-lgr5"
server_key: "41cd56bbd7cebe6b2fb042926dd77331"
server_key_iv: "3d0072548b9424c9fb2cc8d9f0947486"
server_key_version: "kuduclusterkey@0"
I20260808 15:59:06.176127 7956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "3873697dac4e40aa92a427fe99c60f9b"
format_stamp: "Formatted at 2026-08-08 15:59:06 on dist-test-slave-lgr5"
server_key: "41cd56bbd7cebe6b2fb042926dd77331"
server_key_iv: "3d0072548b9424c9fb2cc8d9f0947486"
server_key_version: "kuduclusterkey@0"
I20260808 15:59:06.181605 7956 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260808 15:59:06.202913 7978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:06.204622 7956 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.003s sys 0.001s
I20260808 15:59:06.204771 7956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "3873697dac4e40aa92a427fe99c60f9b"
format_stamp: "Formatted at 2026-08-08 15:59:06 on dist-test-slave-lgr5"
server_key: "41cd56bbd7cebe6b2fb042926dd77331"
server_key_iv: "3d0072548b9424c9fb2cc8d9f0947486"
server_key_version: "kuduclusterkey@0"
I20260808 15:59:06.204918 7956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:06.237778 7956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:06.241400 7956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:06.241637 7956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:06.242375 7956 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:06.243454 7956 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:06.243547 7956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:06.243631 7956 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:06.243685 7956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:06.256898 7956 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:38815
I20260808 15:59:06.258230 7956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:59:06.259325 8155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:38815 every 8 connection(s)
I20260808 15:59:06.266711 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 7956
I20260808 15:59:06.266834 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:59:06.267192 19828 external_mini_cluster.cc:1428] Setting key 6be77c91fde49441059a68b847fd591b
Aug 08 15:59:06 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204746, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:06.281250 7950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:06.264188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:57639 (local address 127.19.93.62:39975)
0808 15:59:06.264316 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:06.264320 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:06.268485 (+ 4165us) server_negotiation.cc:407] Connection header received
0808 15:59:06.269428 (+ 943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:06.269431 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:06.269482 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:06.269553 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:06.271044 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:06.271894 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:06.273608 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:06.273967 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:06.274041 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:06.276980 (+ 2939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:06.276985 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:06.276988 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:06.277016 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:06.278785 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:06.279434 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:06.279438 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:06.279439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:06.279525 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:06.279895 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:06.279898 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:06.279900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:06.280148 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:06.280228 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:06.280919 (+ 691us) server_negotiation.cc:299] Negotiation successful
0808 15:59:06.281058 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 15:59:06.283039 8158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:06.263117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:39975 (local address 127.19.93.2:57639)
0808 15:59:06.268338 (+ 5221us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:06.268385 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:06.269228 (+ 843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:06.269853 (+ 625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:06.269863 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:06.270207 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:06.270873 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:06.270893 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:06.272054 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:06.272057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:06.273466 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:06.273478 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:06.274233 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:06.274236 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:06.274445 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:06.275111 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:06.275131 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:06.276788 (+ 1657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:06.278970 (+ 2182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:06.278976 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:06.278990 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:06.279307 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:06.279624 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:06.279627 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:06.279629 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:06.279792 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:06.280294 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:06.280300 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:06.280622 (+ 322us) client_negotiation.cc:769] Sending connection context
0808 15:59:06.281547 (+ 925us) client_negotiation.cc:240] Negotiation successful
0808 15:59:06.281872 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5020,"thread_start_us":147,"threads_started":1}
I20260808 15:59:06.284698 8156 heartbeater.cc:347] Connected to a master server at 127.19.93.62:39975
I20260808 15:59:06.284934 8156 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:06.285512 8156 heartbeater.cc:511] Master 127.19.93.62:39975 requested a full tablet report, sending...
I20260808 15:59:06.286653 7605 ts_manager.cc:194] Registered new tserver with Master: 3873697dac4e40aa92a427fe99c60f9b (127.19.93.2:38815)
I20260808 15:59:06.287444 7605 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:57639
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 15:59:06.311148 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.93.20:34827/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39975
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:59:06 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204745, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
W20260808 15:59:06.471545 8161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:06.471915 8161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:06.472038 8161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:06.477563 8161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:06.477687 8161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:06.477806 8161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:59:06.486989 8161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.19.93.20:34827/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:06.488581 8161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:06.489975 8161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:06.506100 8172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:06.506572 8175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:06.506940 8168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:06.508026 8161 server_base.cc:1034] running on GCE node
I20260808 15:59:06.508496 8161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:06.509146 8161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:06.512440 8161 hybrid_clock.cc:648] HybridClock initialized: now 1786204746512422 us; error 30 us; skew 500 ppm
Aug 08 15:59:06 dist-test-slave-lgr5 krb5kdc[6831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204746, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:06.515093 8161 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:59:06.515995 8161 webserver.cc:460] Webserver started at http://127.19.93.3:41159/ using document root <none> and password file <none>
I20260808 15:59:06.516557 8161 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:06.516625 8161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:06.516836 8161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 15:59:06 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204746, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
I20260808 15:59:06.531564 8161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "52dc3b9a6e974450a75e9e494ce397d2"
format_stamp: "Formatted at 2026-08-08 15:59:06 on dist-test-slave-lgr5"
server_key: "96975a76196d84a9e620cc4a9860bac6"
server_key_iv: "2b055affcc6e3de3aaf4f63bd24ebe97"
server_key_version: "kuduclusterkey@0"
I20260808 15:59:06.532349 8161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "52dc3b9a6e974450a75e9e494ce397d2"
format_stamp: "Formatted at 2026-08-08 15:59:06 on dist-test-slave-lgr5"
server_key: "96975a76196d84a9e620cc4a9860bac6"
server_key_iv: "2b055affcc6e3de3aaf4f63bd24ebe97"
server_key_version: "kuduclusterkey@0"
I20260808 15:59:06.540231 8161 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.003s sys 0.001s
I20260808 15:59:06.556459 8184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:06.558041 8161 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:59:06.558158 8161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "52dc3b9a6e974450a75e9e494ce397d2"
format_stamp: "Formatted at 2026-08-08 15:59:06 on dist-test-slave-lgr5"
server_key: "96975a76196d84a9e620cc4a9860bac6"
server_key_iv: "2b055affcc6e3de3aaf4f63bd24ebe97"
server_key_version: "kuduclusterkey@0"
I20260808 15:59:06.558277 8161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:06.580483 8161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:06.584056 8161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:06.584302 8161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:06.585041 8161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:06.586094 8161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:06.586202 8161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:06.586303 8161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:06.586370 8161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:06.598302 8161 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:36177
I20260808 15:59:06.599445 8161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:59:06.599673 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 8161
I20260808 15:59:06.599808 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:59:06.600188 19828 external_mini_cluster.cc:1428] Setting key bcbd705c3347ae83cc0ae660b24a90ec
I20260808 15:59:06.606446 8377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:36177 every 8 connection(s)
Aug 08 15:59:06 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204746, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:06.623611 7950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:06.606188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:54179 (local address 127.19.93.62:39975)
0808 15:59:06.606300 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:06.606305 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:06.608332 (+ 2027us) server_negotiation.cc:407] Connection header received
0808 15:59:06.609693 (+ 1361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:06.609697 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:06.609751 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:06.609805 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:06.611835 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:06.612678 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:06.615933 (+ 3255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:06.616301 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:06.616382 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:06.619489 (+ 3107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:06.619493 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:06.619495 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:06.619522 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:06.621187 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:06.621805 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:06.621809 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:06.621811 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:06.621898 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:06.622290 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:06.622293 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:06.622295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:06.622530 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:06.622609 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:06.623312 (+ 703us) server_negotiation.cc:299] Negotiation successful
0808 15:59:06.623444 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 15:59:06.626813 8383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:06.605164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:39975 (local address 127.19.93.3:54179)
0808 15:59:06.608185 (+ 3021us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:06.608242 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:06.609455 (+ 1213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:06.610327 (+ 872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:06.610341 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:06.610802 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:06.611665 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:06.611687 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:06.612845 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:06.612849 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:06.615785 (+ 2936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:06.615796 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:06.616608 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:06.616613 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:06.616817 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:06.617520 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:06.617541 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:06.619284 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:06.621326 (+ 2042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:06.621331 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:06.621345 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:06.621688 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:06.622009 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:06.622011 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:06.622013 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:06.622182 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:06.622694 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:06.622700 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:06.623021 (+ 321us) client_negotiation.cc:769] Sending connection context
0808 15:59:06.624014 (+ 993us) client_negotiation.cc:240] Negotiation successful
0808 15:59:06.624361 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2771,"thread_start_us":152,"threads_started":1}
I20260808 15:59:06.628212 8378 heartbeater.cc:347] Connected to a master server at 127.19.93.62:39975
I20260808 15:59:06.628459 8378 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:06.629034 8378 heartbeater.cc:511] Master 127.19.93.62:39975 requested a full tablet report, sending...
I20260808 15:59:06.630187 7605 ts_manager.cc:194] Registered new tserver with Master: 52dc3b9a6e974450a75e9e494ce397d2 (127.19.93.3:36177)
I20260808 15:59:06.630935 7605 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:54179
I20260808 15:59:06.638665 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:59:06.639554 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 7731
I20260808 15:59:06.667904 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 7956
I20260808 15:59:06.682708 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 8161
I20260808 15:59:06.693986 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 7554
I20260808 15:59:06.714990 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:39975
--webserver_interface=127.19.93.62
--webserver_port=36531
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:39975
--ranger_config_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.93.20:34827/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.93.20:34827/kms with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:06.821745 8384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:06.821972 8384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:06.822007 8384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:06.825878 8384 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:59:06.825927 8384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:06.825946 8384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:06.825977 8384 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:59:06.826005 8384 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:59:06.831213 8384 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.93.20:34827/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:39975
--ranger_config_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:39975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=36531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:06.832165 8384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:06.833103 8384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:59:06.841123 8384 server_base.cc:1034] running on GCE node
W20260808 15:59:06.841029 8398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:06.841027 8392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:06.841068 8400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:06.841799 8384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:06.842831 8384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:06.843984 8384 hybrid_clock.cc:648] HybridClock initialized: now 1786204746843974 us; error 27 us; skew 500 ppm
Aug 08 15:59:06 dist-test-slave-lgr5 krb5kdc[6831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204746, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:06.846510 8384 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:59:06.847339 8384 webserver.cc:460] Webserver started at http://127.19.93.62:36531/ using document root <none> and password file <none>
I20260808 15:59:06.847841 8384 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:06.847914 8384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 15:59:06 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204746, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
I20260808 15:59:06.921065 8384 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:59:06.923202 8415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:06.924450 8384 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 15:59:06.924585 8384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "ee47533923274d1b9ff7a5264af8bb3b"
format_stamp: "Formatted at 2026-08-08 15:59:04 on dist-test-slave-lgr5"
server_key: "db49e4a75e59e4623144232b036a752a"
server_key_iv: "aac07cc9983cde10a788475a7475da56"
server_key_version: "kuduclusterkey@0"
I20260808 15:59:06.925132 8384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:06.950052 8384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:06.952437 8384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:06.952613 8384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:06.959544 8384 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:39975
I20260808 15:59:06.959558 8504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:39975 every 8 connection(s)
I20260808 15:59:06.960608 8384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:59:06.961761 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 8384
I20260808 15:59:06.962249 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.93.20:34827/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:37871
--local_ip_for_outbound_sockets=127.19.93.1
--tserver_master_addrs=127.19.93.62:39975
--webserver_port=44801
--webserver_interface=127.19.93.1
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.93.20:34827/kms with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:59:06.965467 8505 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:59:06.967054 8505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b: Bootstrap starting.
I20260808 15:59:06.982867 8505 log.cc:824] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:06.989792 8505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:59:06.990288 8505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b: Bootstrap complete.
I20260808 15:59:06.994508 8505 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee47533923274d1b9ff7a5264af8bb3b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39975 } }
I20260808 15:59:06.994880 8505 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee47533923274d1b9ff7a5264af8bb3b, State: Initialized, Role: FOLLOWER
I20260808 15:59:06.995388 8505 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee47533923274d1b9ff7a5264af8bb3b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39975 } }
I20260808 15:59:06.995507 8505 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:59:06.995570 8505 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:59:06.995661 8505 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 1 FOLLOWER]: Advancing to term 2
I20260808 15:59:06.997506 8505 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee47533923274d1b9ff7a5264af8bb3b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39975 } }
I20260808 15:59:06.997802 8505 leader_election.cc:302] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee47533923274d1b9ff7a5264af8bb3b; no voters:
I20260808 15:59:06.998073 8505 leader_election.cc:288] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 15:59:06.998169 8510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 2 FOLLOWER]: Leader election won for term 2
I20260808 15:59:06.998355 8510 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [term 2 LEADER]: Becoming Leader. State: Replica: ee47533923274d1b9ff7a5264af8bb3b, State: Running, Role: LEADER
I20260808 15:59:06.998701 8510 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee47533923274d1b9ff7a5264af8bb3b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39975 } }
I20260808 15:59:06.999281 8505 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:59:06.999619 8510 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee47533923274d1b9ff7a5264af8bb3b. Latest consensus state: current_term: 2 leader_uuid: "ee47533923274d1b9ff7a5264af8bb3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee47533923274d1b9ff7a5264af8bb3b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39975 } } }
I20260808 15:59:06.999735 8510 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:07.000432 8511 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ee47533923274d1b9ff7a5264af8bb3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee47533923274d1b9ff7a5264af8bb3b" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39975 } } }
I20260808 15:59:07.000597 8511 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:07.001113 8520 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:59:07.001606 8505 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 15:59:07.007001 8520 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:59:07.007977 8520 catalog_manager.cc:1259] Loaded cluster ID: 69bb8f7f0206466b98aca8385538616b
I20260808 15:59:07.008024 8520 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:59:07.009971 8520 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:59:07.010617 8520 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b: Loaded TSK: 0
I20260808 15:59:07.011842 8520 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 15:59:07.079512 8508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:07.079926 8508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:07.079999 8508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:07.084583 8508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:07.084638 8508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:07.084714 8508 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:59:07.090225 8508 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.93.20:34827/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:37871
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=44801
--tserver_master_addrs=127.19.93.62:39975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:07.091423 8508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:07.092470 8508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:07.103817 8571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:07.104230 8574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:07.104327 8578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:07.104592 8508 server_base.cc:1034] running on GCE node
I20260808 15:59:07.105139 8508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:07.105890 8508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:07.110260 8508 hybrid_clock.cc:648] HybridClock initialized: now 1786204747110231 us; error 33 us; skew 500 ppm
Aug 08 15:59:07 dist-test-slave-lgr5 krb5kdc[6831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204747, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:07.113336 8508 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:59:07.114253 8508 webserver.cc:460] Webserver started at http://127.19.93.1:44801/ using document root <none> and password file <none>
I20260808 15:59:07.114802 8508 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:07.114910 8508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 15:59:07 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204747, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
I20260808 15:59:07.142307 8508 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.002s sys 0.000s
I20260808 15:59:07.148808 8590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:07.150194 8508 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.003s sys 0.001s
I20260808 15:59:07.150314 8508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "70813ff08a8f4408aaa5147d75bc79a1"
format_stamp: "Formatted at 2026-08-08 15:59:05 on dist-test-slave-lgr5"
server_key: "b2ca758e74ec13391d9857911b5f9693"
server_key_iv: "b3cf4a64076dfff214f56cfa415bcd2e"
server_key_version: "kuduclusterkey@0"
I20260808 15:59:07.150893 8508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:07.171345 8508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:07.174245 8508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:07.174432 8508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:07.175027 8508 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:07.175896 8508 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:07.175945 8508 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:07.175998 8508 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:07.176023 8508 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:07.186317 8508 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:37871
I20260808 15:59:07.186512 8779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:37871 every 8 connection(s)
I20260808 15:59:07.187343 8508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:59:07.190605 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 8508
I20260808 15:59:07.191104 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.93.20:34827/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:38815
--local_ip_for_outbound_sockets=127.19.93.2
--tserver_master_addrs=127.19.93.62:39975
--webserver_port=38253
--webserver_interface=127.19.93.2
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.93.20:34827/kms with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:59:07 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204747, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:07.208259 8783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:07.189779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:39975 (local address 127.19.93.1:57165)
0808 15:59:07.193078 (+ 3299us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:07.193135 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:07.194135 (+ 1000us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:07.196004 (+ 1869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:07.196011 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:07.196358 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:07.196992 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:07.197013 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:07.198273 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:07.198277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:07.199201 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:07.199212 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:07.200194 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:07.200199 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:07.200566 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:07.201308 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:07.201328 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:07.202829 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:07.204978 (+ 2149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:07.204983 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:07.204996 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:07.205231 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:07.205559 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:07.205562 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:07.205564 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:07.205691 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:07.206473 (+ 782us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:07.206479 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:07.206775 (+ 296us) client_negotiation.cc:769] Sending connection context
0808 15:59:07.206976 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 15:59:07.207291 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3063,"thread_start_us":131,"threads_started":1}
I20260808 15:59:07.209995 8782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:07.189642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:57165 (local address 127.19.93.62:39975)
0808 15:59:07.190248 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:07.190270 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:07.194445 (+ 4175us) server_negotiation.cc:407] Connection header received
0808 15:59:07.194744 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:07.194759 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:07.195181 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:07.195521 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:07.197198 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:07.198142 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:07.199317 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:07.199851 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:07.200334 (+ 483us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:07.203052 (+ 2718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:07.203057 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:07.203069 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:07.203094 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:07.204858 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:07.205351 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:07.205357 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:07.205360 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:07.205469 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:07.205785 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:07.205788 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:07.205790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:07.206221 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:07.206415 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:07.208798 (+ 2383us) server_negotiation.cc:299] Negotiation successful
0808 15:59:07.209129 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":119,"threads_started":1}
I20260808 15:59:07.213143 8780 heartbeater.cc:347] Connected to a master server at 127.19.93.62:39975
I20260808 15:59:07.213370 8780 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:07.213791 8780 heartbeater.cc:511] Master 127.19.93.62:39975 requested a full tablet report, sending...
W20260808 15:59:07.215603 8780 heartbeater.cc:644] Failed to heartbeat to 127.19.93.62:39975 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 15:59:07.215713 8780 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:07.215864 8780 heartbeater.cc:511] Master 127.19.93.62:39975 requested a full tablet report, sending...
I20260808 15:59:07.216712 8780 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:07.216869 8780 heartbeater.cc:511] Master 127.19.93.62:39975 requested a full tablet report, sending...
W20260808 15:59:07.217690 8780 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 15:59:07.367415 8784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:07.367749 8784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:07.367825 8784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:07.373644 8784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:07.373715 8784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:07.373799 8784 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:59:07.381199 8784 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.93.20:34827/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:38815
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=38253
--tserver_master_addrs=127.19.93.62:39975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:07.382501 8784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:07.383888 8784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:07.396409 8793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:07.396430 8795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:07.396442 8797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:07.396848 8784 server_base.cc:1034] running on GCE node
I20260808 15:59:07.397222 8784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:07.397825 8784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:07.398983 8784 hybrid_clock.cc:648] HybridClock initialized: now 1786204747398954 us; error 47 us; skew 500 ppm
Aug 08 15:59:07 dist-test-slave-lgr5 krb5kdc[6831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204747, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:07.402117 8784 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:59:07.402933 8784 webserver.cc:460] Webserver started at http://127.19.93.2:38253/ using document root <none> and password file <none>
I20260808 15:59:07.403452 8784 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:07.403520 8784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 15:59:07 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204747, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
I20260808 15:59:07.421701 8784 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 15:59:07.424649 8815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:07.426079 8784 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:59:07.426205 8784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "3873697dac4e40aa92a427fe99c60f9b"
format_stamp: "Formatted at 2026-08-08 15:59:06 on dist-test-slave-lgr5"
server_key: "41cd56bbd7cebe6b2fb042926dd77331"
server_key_iv: "3d0072548b9424c9fb2cc8d9f0947486"
server_key_version: "kuduclusterkey@0"
I20260808 15:59:07.426919 8784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:07.449002 8784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:07.452625 8784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:07.452812 8784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:07.453491 8784 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:07.454625 8784 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:07.454684 8784 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:07.454737 8784 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:07.454758 8784 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:07.468879 8784 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:38815
I20260808 15:59:07.470148 8784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:59:07.470728 9000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:38815 every 8 connection(s)
I20260808 15:59:07.476670 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 8784
I20260808 15:59:07.477159 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.93.20:34827/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:36177
--local_ip_for_outbound_sockets=127.19.93.3
--tserver_master_addrs=127.19.93.62:39975
--webserver_port=41159
--webserver_interface=127.19.93.3
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:45647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.93.20:34827/kms with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:59:07 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204747, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:07.498180 8782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:07.474268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:49941 (local address 127.19.93.62:39975)
0808 15:59:07.474441 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:07.474447 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:07.477315 (+ 2868us) server_negotiation.cc:407] Connection header received
0808 15:59:07.478597 (+ 1282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:07.478601 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:07.478660 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:07.478722 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:07.480397 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:07.481000 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:07.490383 (+ 9383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:07.490739 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:07.490845 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:07.494082 (+ 3237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:07.494086 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:07.494089 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:07.494121 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:07.495795 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:07.496420 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:07.496424 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:07.496426 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:07.496510 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:07.496922 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:07.496925 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:07.496927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:07.497144 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:07.497219 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:07.497877 (+ 658us) server_negotiation.cc:299] Negotiation successful
0808 15:59:07.498006 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 15:59:07.500028 9005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:07.473140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:39975 (local address 127.19.93.2:49941)
0808 15:59:07.477149 (+ 4009us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:07.477205 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:07.478342 (+ 1137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:07.479170 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:07.479179 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:07.479521 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:07.480203 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:07.480223 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:07.481169 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:07.481172 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:07.484496 (+ 3324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:07.484508 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:07.491085 (+ 6577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:07.491090 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:07.491318 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:07.492143 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:07.492165 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:07.493886 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:07.495935 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:07.495941 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:07.495957 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:07.496307 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:07.496609 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:07.496611 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:07.496614 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:07.496778 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:07.497282 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:07.497288 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:07.497602 (+ 314us) client_negotiation.cc:769] Sending connection context
0808 15:59:07.498576 (+ 974us) client_negotiation.cc:240] Negotiation successful
0808 15:59:07.498915 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3773,"thread_start_us":166,"threads_started":1}
I20260808 15:59:07.501622 9001 heartbeater.cc:347] Connected to a master server at 127.19.93.62:39975
I20260808 15:59:07.501868 9001 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:07.502419 9001 heartbeater.cc:511] Master 127.19.93.62:39975 requested a full tablet report, sending...
W20260808 15:59:07.504208 9001 heartbeater.cc:644] Failed to heartbeat to 127.19.93.62:39975 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 15:59:07.504323 9001 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:07.504472 9001 heartbeater.cc:511] Master 127.19.93.62:39975 requested a full tablet report, sending...
I20260808 15:59:07.505271 9001 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:07.505429 9001 heartbeater.cc:511] Master 127.19.93.62:39975 requested a full tablet report, sending...
W20260808 15:59:07.506192 9001 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 15:59:07.618054 9006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:07.618300 9006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:07.618371 9006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:07.622418 9006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:07.622474 9006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:07.622550 9006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:59:07.627669 9006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:45647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.93.20:34827/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:36177
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=41159
--tserver_master_addrs=127.19.93.62:39975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:07.628883 9006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:07.630034 9006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:07.641057 9014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:07.641326 9015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:07.641577 9018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:07.641804 9006 server_base.cc:1034] running on GCE node
I20260808 15:59:07.642234 9006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:07.642942 9006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:07.646243 9006 hybrid_clock.cc:648] HybridClock initialized: now 1786204747646209 us; error 42 us; skew 500 ppm
Aug 08 15:59:07 dist-test-slave-lgr5 krb5kdc[6831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204747, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:07.649101 9006 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:59:07.649971 9006 webserver.cc:460] Webserver started at http://127.19.93.3:41159/ using document root <none> and password file <none>
I20260808 15:59:07.650480 9006 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:07.650563 9006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 15:59:07 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204747, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
I20260808 15:59:07.671552 9006 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:59:07.674978 9031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:07.676419 9006 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 15:59:07.676537 9006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "52dc3b9a6e974450a75e9e494ce397d2"
format_stamp: "Formatted at 2026-08-08 15:59:06 on dist-test-slave-lgr5"
server_key: "96975a76196d84a9e620cc4a9860bac6"
server_key_iv: "2b055affcc6e3de3aaf4f63bd24ebe97"
server_key_version: "kuduclusterkey@0"
I20260808 15:59:07.677084 9006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:07.710250 9006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:07.713488 9006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:07.713672 9006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:07.714270 9006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:07.715167 9006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:07.715226 9006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:07.715327 9006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:07.715358 9006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:07.727233 9006 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:36177
I20260808 15:59:07.728752 9006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:59:07.738758 9214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:36177 every 8 connection(s)
I20260808 15:59:07.738864 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 9006
Aug 08 15:59:07 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204747, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:07.749287 9226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:07.739629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55956 (local address 127.19.93.62:39975)
0808 15:59:07.740822 (+ 1193us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:07.740827 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:07.740853 (+ 26us) server_negotiation.cc:407] Connection header received
0808 15:59:07.740894 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:07.740897 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:07.740942 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:07.741031 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:07.742083 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:07.742935 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:07.744128 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:07.744349 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:07.744434 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:07.745903 (+ 1469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:07.745907 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:07.745910 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:07.745933 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:07.747412 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:07.747981 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:07.747985 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:07.747987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:07.748067 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:07.748333 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:07.748336 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:07.748337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:07.748556 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:07.748754 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:07.748986 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 15:59:07.749106 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1117,"thread_start_us":75,"threads_started":1}
I20260808 15:59:07.751860 8782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:07.736848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:34253 (local address 127.19.93.62:39975)
0808 15:59:07.738570 (+ 1722us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:07.738576 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:07.739442 (+ 866us) server_negotiation.cc:407] Connection header received
0808 15:59:07.740824 (+ 1382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:07.740828 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:07.740886 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:07.740944 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:07.742606 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:07.743419 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:07.745068 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:07.745377 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:07.745483 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:07.748201 (+ 2718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:07.748204 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:07.748207 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:07.748232 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:07.749803 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:07.750406 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:07.750410 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:07.750412 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:07.750498 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:07.750866 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:07.750869 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:07.750870 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:07.751019 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:07.751088 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:07.751679 (+ 591us) server_negotiation.cc:299] Negotiation successful
0808 15:59:07.751760 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1603}
I20260808 15:59:07.753080 9219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:07.737138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:39975 (local address 127.19.93.3:34253)
0808 15:59:07.739278 (+ 2140us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:07.739336 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:07.740570 (+ 1234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:07.741372 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:07.741394 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:07.741739 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:07.742441 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:07.742461 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:07.743582 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:07.743586 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:07.744955 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:07.744966 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:07.745540 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:07.745544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:07.745747 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:07.746363 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:07.746392 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:07.747993 (+ 1601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:07.749929 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:07.749935 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:07.749948 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:07.750266 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:07.750607 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:07.750610 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:07.750612 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:07.750775 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:07.751106 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:07.751112 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:07.751436 (+ 324us) client_negotiation.cc:769] Sending connection context
0808 15:59:07.751644 (+ 208us) client_negotiation.cc:240] Negotiation successful
0808 15:59:07.752030 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1906,"thread_start_us":151,"threads_started":1}
I20260808 15:59:07.754171 9217 heartbeater.cc:347] Connected to a master server at 127.19.93.62:39975
I20260808 15:59:07.754405 9217 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:07.754853 9217 heartbeater.cc:511] Master 127.19.93.62:39975 requested a full tablet report, sending...
W20260808 15:59:07.756453 9217 heartbeater.cc:644] Failed to heartbeat to 127.19.93.62:39975 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 15:59:07.756564 9217 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:07.756711 9217 heartbeater.cc:511] Master 127.19.93.62:39975 requested a full tablet report, sending...
I20260808 15:59:07.757444 9217 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:07.757586 9217 heartbeater.cc:511] Master 127.19.93.62:39975 requested a full tablet report, sending...
W20260808 15:59:07.758247 9217 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 15:59:08 dist-test-slave-lgr5 krb5kdc[6831](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786204748, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:08.217927 8780 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:08.218223 8780 heartbeater.cc:511] Master 127.19.93.62:39975 requested a full tablet report, sending...
I20260808 15:59:08.219419 8444 ts_manager.cc:194] Registered new tserver with Master: 70813ff08a8f4408aaa5147d75bc79a1 (127.19.93.1:37871)
I20260808 15:59:08.221151 8444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:57165
Aug 08 15:59:08 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204748, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
I20260808 15:59:08.506420 9001 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:08.506714 9001 heartbeater.cc:511] Master 127.19.93.62:39975 requested a full tablet report, sending...
I20260808 15:59:08.507401 8444 ts_manager.cc:194] Registered new tserver with Master: 3873697dac4e40aa92a427fe99c60f9b (127.19.93.2:38815)
I20260808 15:59:08.508189 8444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:49941
Aug 08 15:59:08 dist-test-slave-lgr5 krb5kdc[6831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204748, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for HTTP/127.19.93.20@KRBTEST.COM
I20260808 15:59:08.758447 9217 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:08.758757 9217 heartbeater.cc:511] Master 127.19.93.62:39975 requested a full tablet report, sending...
I20260808 15:59:08.759577 8444 ts_manager.cc:194] Registered new tserver with Master: 52dc3b9a6e974450a75e9e494ce397d2 (127.19.93.3:36177)
I20260808 15:59:08.760396 8444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:34253
I20260808 15:59:08.769560 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:59:08.783885 9255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:08.771308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55966 (local address 127.19.93.62:39975)
0808 15:59:08.771940 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:08.771945 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:08.772519 (+ 574us) server_negotiation.cc:407] Connection header received
0808 15:59:08.774198 (+ 1679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:08.774202 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:08.774254 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:08.774345 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:08.775271 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.776124 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.777323 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.777668 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.777770 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:08.779567 (+ 1797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:08.779572 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:08.779575 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:08.779601 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:08.781586 (+ 1985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:08.782063 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:08.782066 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:08.782068 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:08.782165 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:08.782607 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:08.782611 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:08.782613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:08.782880 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:08.783016 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:08.783271 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 15:59:08.783407 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":110,"threads_started":1}
I20260808 15:59:08.788251 8444 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55966:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:59:08.792735 8444 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:59:08.815696 9271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:08.805848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:36177 (local address 127.0.0.1:55364)
0808 15:59:08.808487 (+ 2639us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:08.808497 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:08.808561 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:08.809288 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:08.809294 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:08.809320 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:08.809461 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:08.809467 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.811851 (+ 2384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.811855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:08.813882 (+ 2027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:08.813888 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.815158 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.815162 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:08.815277 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:08.815319 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 15:59:08.815424 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 15:59:08.815538 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2592,"thread_start_us":84,"threads_started":1}
I20260808 15:59:08.816196 9272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:08.806240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55364 (local address 127.19.93.3:36177)
0808 15:59:08.808737 (+ 2497us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:08.808742 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:08.808760 (+ 18us) server_negotiation.cc:407] Connection header received
0808 15:59:08.808819 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:08.808823 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:08.808972 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:08.809095 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:08.809581 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.811718 (+ 2137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.814014 (+ 2296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.814821 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.814929 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:08.815091 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:08.815907 (+ 816us) server_negotiation.cc:299] Negotiation successful
0808 15:59:08.816010 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2412,"thread_start_us":82,"threads_started":1}
I20260808 15:59:08.819209 9109 tablet_service.cc:1467] Processing CreateTablet for tablet ff646b7e88d14e94a06ce976fb1c694b (DEFAULT_TABLE table=test-table [id=df60a757863d4737a8266f72cda9b61d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:59:08.820227 9109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff646b7e88d14e94a06ce976fb1c694b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:08.821254 9269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:08.806931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:37871 (local address 127.0.0.1:56368)
0808 15:59:08.809662 (+ 2731us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:08.809674 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:08.809754 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:08.811314 (+ 1560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:08.811317 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:08.811399 (+ 82us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:08.811479 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:08.811485 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.812850 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.812853 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:08.813877 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:08.813888 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.820866 (+ 6978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.820870 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:08.820960 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:08.820986 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 15:59:08.821048 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 15:59:08.821126 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2671,"thread_start_us":92,"threads_started":1}
I20260808 15:59:08.822443 9279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:08.807373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56368 (local address 127.19.93.1:37871)
0808 15:59:08.808382 (+ 1009us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:08.808387 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:08.809840 (+ 1453us) server_negotiation.cc:407] Connection header received
0808 15:59:08.809920 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:08.809925 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:08.810107 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:08.810235 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:08.811597 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.812722 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.814014 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.814821 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.814928 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:08.821433 (+ 6505us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:08.822200 (+ 767us) server_negotiation.cc:299] Negotiation successful
0808 15:59:08.822305 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":908,"thread_start_us":67,"threads_started":1}
I20260808 15:59:08.825284 8652 tablet_service.cc:1467] Processing CreateTablet for tablet ff646b7e88d14e94a06ce976fb1c694b (DEFAULT_TABLE table=test-table [id=df60a757863d4737a8266f72cda9b61d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:59:08.826345 8652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff646b7e88d14e94a06ce976fb1c694b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:08.831199 9274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:08.804212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:38815 (local address 127.0.0.1:45284)
0808 15:59:08.807973 (+ 3761us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:08.808009 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:08.808136 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:08.811101 (+ 2965us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:08.811104 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:08.811121 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:08.811209 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:08.811215 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.828156 (+ 16941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.828159 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:08.829356 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:08.829369 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.830763 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.830767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:08.830863 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:08.830901 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 15:59:08.830973 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 15:59:08.831049 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3586,"thread_start_us":127,"threads_started":1}
I20260808 15:59:08.831640 9270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:08.805091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45284 (local address 127.19.93.2:38815)
0808 15:59:08.810554 (+ 5463us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:08.810559 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:08.810581 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:59:08.810653 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:08.810658 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:08.810819 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:08.810939 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:08.815269 (+ 4330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.820706 (+ 5437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.829537 (+ 8831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.830437 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.830550 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:08.830695 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:08.831391 (+ 696us) server_negotiation.cc:299] Negotiation successful
0808 15:59:08.831497 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5359,"thread_start_us":94,"threads_started":1}
I20260808 15:59:08.834699 8881 tablet_service.cc:1467] Processing CreateTablet for tablet ff646b7e88d14e94a06ce976fb1c694b (DEFAULT_TABLE table=test-table [id=df60a757863d4737a8266f72cda9b61d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:59:08.835783 8881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff646b7e88d14e94a06ce976fb1c694b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:08.839097 9280 tablet_bootstrap.cc:492] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2: Bootstrap starting.
I20260808 15:59:08.841542 9280 tablet_bootstrap.cc:654] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:08.842504 9280 log.cc:824] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:08.844419 9282 tablet_bootstrap.cc:492] T ff646b7e88d14e94a06ce976fb1c694b P 70813ff08a8f4408aaa5147d75bc79a1: Bootstrap starting.
I20260808 15:59:08.845088 9280 tablet_bootstrap.cc:492] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2: No bootstrap required, opened a new log
I20260808 15:59:08.845288 9280 ts_tablet_manager.cc:1397] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 15:59:08.846849 9282 tablet_bootstrap.cc:654] T ff646b7e88d14e94a06ce976fb1c694b P 70813ff08a8f4408aaa5147d75bc79a1: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:08.847725 9282 log.cc:824] T ff646b7e88d14e94a06ce976fb1c694b P 70813ff08a8f4408aaa5147d75bc79a1: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:08.849316 9280 raft_consensus.cc:348] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3873697dac4e40aa92a427fe99c60f9b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 38815 } } peers { permanent_uuid: "52dc3b9a6e974450a75e9e494ce397d2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36177 } } peers { permanent_uuid: "70813ff08a8f4408aaa5147d75bc79a1" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37871 } }
I20260808 15:59:08.849630 9280 raft_consensus.cc:374] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:08.849694 9280 raft_consensus.cc:729] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52dc3b9a6e974450a75e9e494ce397d2, State: Initialized, Role: FOLLOWER
I20260808 15:59:08.850154 9280 consensus_queue.cc:260] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3873697dac4e40aa92a427fe99c60f9b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 38815 } } peers { permanent_uuid: "52dc3b9a6e974450a75e9e494ce397d2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36177 } } peers { permanent_uuid: "70813ff08a8f4408aaa5147d75bc79a1" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37871 } }
I20260808 15:59:08.851135 9280 ts_tablet_manager.cc:1428] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 15:59:08.851509 9217 heartbeater.cc:503] Master 127.19.93.62:39975 was elected leader, sending a full tablet report...
I20260808 15:59:08.851833 9284 tablet_bootstrap.cc:492] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b: Bootstrap starting.
I20260808 15:59:08.853909 9284 tablet_bootstrap.cc:654] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:08.854681 9284 log.cc:824] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:08.857731 9284 tablet_bootstrap.cc:492] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b: No bootstrap required, opened a new log
I20260808 15:59:08.857856 9282 tablet_bootstrap.cc:492] T ff646b7e88d14e94a06ce976fb1c694b P 70813ff08a8f4408aaa5147d75bc79a1: No bootstrap required, opened a new log
I20260808 15:59:08.857942 9284 ts_tablet_manager.cc:1397] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:59:08.858125 9282 ts_tablet_manager.cc:1397] T ff646b7e88d14e94a06ce976fb1c694b P 70813ff08a8f4408aaa5147d75bc79a1: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.002s
I20260808 15:59:08.861816 9284 raft_consensus.cc:348] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3873697dac4e40aa92a427fe99c60f9b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 38815 } } peers { permanent_uuid: "52dc3b9a6e974450a75e9e494ce397d2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36177 } } peers { permanent_uuid: "70813ff08a8f4408aaa5147d75bc79a1" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37871 } }
I20260808 15:59:08.862102 9284 raft_consensus.cc:374] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:08.862169 9284 raft_consensus.cc:729] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3873697dac4e40aa92a427fe99c60f9b, State: Initialized, Role: FOLLOWER
I20260808 15:59:08.862185 9282 raft_consensus.cc:348] T ff646b7e88d14e94a06ce976fb1c694b P 70813ff08a8f4408aaa5147d75bc79a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3873697dac4e40aa92a427fe99c60f9b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 38815 } } peers { permanent_uuid: "52dc3b9a6e974450a75e9e494ce397d2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36177 } } peers { permanent_uuid: "70813ff08a8f4408aaa5147d75bc79a1" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37871 } }
I20260808 15:59:08.862550 9282 raft_consensus.cc:374] T ff646b7e88d14e94a06ce976fb1c694b P 70813ff08a8f4408aaa5147d75bc79a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:08.862640 9282 raft_consensus.cc:729] T ff646b7e88d14e94a06ce976fb1c694b P 70813ff08a8f4408aaa5147d75bc79a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70813ff08a8f4408aaa5147d75bc79a1, State: Initialized, Role: FOLLOWER
I20260808 15:59:08.862696 9284 consensus_queue.cc:260] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3873697dac4e40aa92a427fe99c60f9b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 38815 } } peers { permanent_uuid: "52dc3b9a6e974450a75e9e494ce397d2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36177 } } peers { permanent_uuid: "70813ff08a8f4408aaa5147d75bc79a1" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37871 } }
I20260808 15:59:08.863135 9282 consensus_queue.cc:260] T ff646b7e88d14e94a06ce976fb1c694b P 70813ff08a8f4408aaa5147d75bc79a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3873697dac4e40aa92a427fe99c60f9b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 38815 } } peers { permanent_uuid: "52dc3b9a6e974450a75e9e494ce397d2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36177 } } peers { permanent_uuid: "70813ff08a8f4408aaa5147d75bc79a1" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37871 } }
I20260808 15:59:08.863924 9284 ts_tablet_manager.cc:1428] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 15:59:08.864212 9282 ts_tablet_manager.cc:1428] T ff646b7e88d14e94a06ce976fb1c694b P 70813ff08a8f4408aaa5147d75bc79a1: Time spent starting tablet: real 0.006s user 0.004s sys 0.001s
I20260808 15:59:08.864326 9001 heartbeater.cc:503] Master 127.19.93.62:39975 was elected leader, sending a full tablet report...
I20260808 15:59:08.864639 8780 heartbeater.cc:503] Master 127.19.93.62:39975 was elected leader, sending a full tablet report...
I20260808 15:59:08.874389 9287 raft_consensus.cc:482] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:59:08.874588 9287 raft_consensus.cc:504] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3873697dac4e40aa92a427fe99c60f9b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 38815 } } peers { permanent_uuid: "52dc3b9a6e974450a75e9e494ce397d2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36177 } } peers { permanent_uuid: "70813ff08a8f4408aaa5147d75bc79a1" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37871 } }
I20260808 15:59:08.875809 9287 leader_election.cc:288] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3873697dac4e40aa92a427fe99c60f9b (127.19.93.2:38815), 70813ff08a8f4408aaa5147d75bc79a1 (127.19.93.1:37871)
I20260808 15:59:08.887456 9279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:08.877465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:56235 (local address 127.19.93.1:37871)
0808 15:59:08.877586 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:08.877590 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:08.883275 (+ 5685us) server_negotiation.cc:407] Connection header received
0808 15:59:08.883351 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:08.883354 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:08.883406 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:08.883483 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:08.883866 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.884631 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.886098 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.886729 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.886807 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:08.886868 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:08.887213 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 15:59:08.887302 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:59:08.887506 9270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:08.876712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:53341 (local address 127.19.93.2:38815)
0808 15:59:08.876820 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:08.876824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:08.882309 (+ 5485us) server_negotiation.cc:407] Connection header received
0808 15:59:08.882550 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:08.882554 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:08.882603 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:08.882649 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:08.883081 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.883827 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.885531 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.886163 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.886247 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:08.886316 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:08.887286 (+ 970us) server_negotiation.cc:299] Negotiation successful
0808 15:59:08.887377 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 15:59:08.887908 9293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:08.876245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:38815 (local address 127.19.93.3:53341)
0808 15:59:08.882202 (+ 5957us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:08.882218 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:08.882412 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:08.882797 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:08.882800 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:08.882821 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:08.882957 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:08.882963 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.883988 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.883992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:08.885377 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:08.885389 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.886415 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.886418 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:08.886522 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:08.886546 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:59:08.887648 (+ 1102us) client_negotiation.cc:240] Negotiation successful
0808 15:59:08.887726 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5877,"thread_start_us":155,"threads_started":1}
I20260808 15:59:08.888675 8925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff646b7e88d14e94a06ce976fb1c694b" candidate_uuid: "52dc3b9a6e974450a75e9e494ce397d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3873697dac4e40aa92a427fe99c60f9b" is_pre_election: true
I20260808 15:59:08.889039 8925 raft_consensus.cc:2454] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52dc3b9a6e974450a75e9e494ce397d2 in term 0.
I20260808 15:59:08.889343 9294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:08.877026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:37871 (local address 127.19.93.3:56235)
0808 15:59:08.883167 (+ 6141us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:08.883180 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:08.883265 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:08.883591 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:08.883594 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:08.883611 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:08.883730 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:08.883736 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.884774 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.884777 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:08.885957 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:08.885969 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.886982 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.886985 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:08.887089 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:08.887110 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 15:59:08.887938 (+ 828us) client_negotiation.cc:240] Negotiation successful
0808 15:59:08.888222 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6075,"thread_start_us":110,"threads_started":1}
I20260808 15:59:08.889585 9034 leader_election.cc:302] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3873697dac4e40aa92a427fe99c60f9b, 52dc3b9a6e974450a75e9e494ce397d2; no voters:
I20260808 15:59:08.890071 8700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff646b7e88d14e94a06ce976fb1c694b" candidate_uuid: "52dc3b9a6e974450a75e9e494ce397d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70813ff08a8f4408aaa5147d75bc79a1" is_pre_election: true
I20260808 15:59:08.890357 8700 raft_consensus.cc:2454] T ff646b7e88d14e94a06ce976fb1c694b P 70813ff08a8f4408aaa5147d75bc79a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52dc3b9a6e974450a75e9e494ce397d2 in term 0.
I20260808 15:59:08.890625 9287 raft_consensus.cc:2781] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:59:08.890712 9287 raft_consensus.cc:482] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:59:08.890749 9287 raft_consensus.cc:3037] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:08.892009 9287 raft_consensus.cc:504] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3873697dac4e40aa92a427fe99c60f9b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 38815 } } peers { permanent_uuid: "52dc3b9a6e974450a75e9e494ce397d2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36177 } } peers { permanent_uuid: "70813ff08a8f4408aaa5147d75bc79a1" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37871 } }
I20260808 15:59:08.892400 9287 leader_election.cc:288] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [CANDIDATE]: Term 1 election: Requested vote from peers 3873697dac4e40aa92a427fe99c60f9b (127.19.93.2:38815), 70813ff08a8f4408aaa5147d75bc79a1 (127.19.93.1:37871)
I20260808 15:59:08.892884 8700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff646b7e88d14e94a06ce976fb1c694b" candidate_uuid: "52dc3b9a6e974450a75e9e494ce397d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70813ff08a8f4408aaa5147d75bc79a1"
I20260808 15:59:08.892891 8925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff646b7e88d14e94a06ce976fb1c694b" candidate_uuid: "52dc3b9a6e974450a75e9e494ce397d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3873697dac4e40aa92a427fe99c60f9b"
I20260808 15:59:08.893000 8700 raft_consensus.cc:3037] T ff646b7e88d14e94a06ce976fb1c694b P 70813ff08a8f4408aaa5147d75bc79a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:08.893023 8925 raft_consensus.cc:3037] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:08.894132 8700 raft_consensus.cc:2454] T ff646b7e88d14e94a06ce976fb1c694b P 70813ff08a8f4408aaa5147d75bc79a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52dc3b9a6e974450a75e9e494ce397d2 in term 1.
I20260808 15:59:08.894344 8925 raft_consensus.cc:2454] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52dc3b9a6e974450a75e9e494ce397d2 in term 1.
I20260808 15:59:08.894526 9037 leader_election.cc:302] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52dc3b9a6e974450a75e9e494ce397d2, 70813ff08a8f4408aaa5147d75bc79a1; no voters:
I20260808 15:59:08.894740 9287 raft_consensus.cc:2781] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:59:08.894949 9287 raft_consensus.cc:686] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [term 1 LEADER]: Becoming Leader. State: Replica: 52dc3b9a6e974450a75e9e494ce397d2, State: Running, Role: LEADER
I20260808 15:59:08.895295 9287 consensus_queue.cc:237] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3873697dac4e40aa92a427fe99c60f9b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 38815 } } peers { permanent_uuid: "52dc3b9a6e974450a75e9e494ce397d2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36177 } } peers { permanent_uuid: "70813ff08a8f4408aaa5147d75bc79a1" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37871 } }
I20260808 15:59:08.898811 8443 catalog_manager.cc:5495] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52dc3b9a6e974450a75e9e494ce397d2 (127.19.93.3). New cstate: current_term: 1 leader_uuid: "52dc3b9a6e974450a75e9e494ce397d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3873697dac4e40aa92a427fe99c60f9b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 38815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52dc3b9a6e974450a75e9e494ce397d2" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70813ff08a8f4408aaa5147d75bc79a1" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37871 } health_report { overall_health: UNKNOWN } } }
I20260808 15:59:08.936831 9272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:08.931972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55374 (local address 127.19.93.3:36177)
0808 15:59:08.932105 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:08.932109 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:08.932123 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:59:08.932202 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:08.932204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:08.932258 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:08.932354 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:59:08.932641 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.933420 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.934625 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:08.934966 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:08.935074 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:08.935504 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:59:08.936033 (+ 529us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:59:08.936222 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:08.936611 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 15:59:08.936677 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 15:59:08.939718 8781 tablet.cc:2369] T ff646b7e88d14e94a06ce976fb1c694b P 70813ff08a8f4408aaa5147d75bc79a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:59:08.944142 8700 raft_consensus.cc:1261] T ff646b7e88d14e94a06ce976fb1c694b P 70813ff08a8f4408aaa5147d75bc79a1 [term 1 FOLLOWER]: Refusing update from remote peer 52dc3b9a6e974450a75e9e494ce397d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:59:08.944267 8925 raft_consensus.cc:1261] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b [term 1 FOLLOWER]: Refusing update from remote peer 52dc3b9a6e974450a75e9e494ce397d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:59:08.945073 9287 consensus_queue.cc:1035] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70813ff08a8f4408aaa5147d75bc79a1" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:59:08.945575 9295 consensus_queue.cc:1035] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3873697dac4e40aa92a427fe99c60f9b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 38815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:59:08.974691 9301 mvcc.cc:205] Tried to move back new op lower bound from 7316294651667517440 to 7316294651477905408. Current Snapshot: MvccSnapshot[applied={T|T < 7316294651667517440}]
I20260808 15:59:08.975400 9305 mvcc.cc:205] Tried to move back new op lower bound from 7316294651667517440 to 7316294651477905408. Current Snapshot: MvccSnapshot[applied={T|T < 7316294651667517440}]
I20260808 15:59:08.975766 9303 mvcc.cc:205] Tried to move back new op lower bound from 7316294651667517440 to 7316294651477905408. Current Snapshot: MvccSnapshot[applied={T|T < 7316294651667517440}]
I20260808 15:59:08.989364 8441 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55966:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:59:08.989552 8441 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55966:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:59:08.992291 8441 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ee47533923274d1b9ff7a5264af8bb3b: Sending DeleteTablet for 3 replicas of tablet ff646b7e88d14e94a06ce976fb1c694b
I20260808 15:59:08.995436 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 8508
I20260808 15:59:09.002795 8881 tablet_service.cc:1514] Processing DeleteTablet for tablet ff646b7e88d14e94a06ce976fb1c694b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:59:08 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:45284
I20260808 15:59:09.003539 9109 tablet_service.cc:1514] Processing DeleteTablet for tablet ff646b7e88d14e94a06ce976fb1c694b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:59:08 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:55364
I20260808 15:59:09.012355 9316 tablet_replica.cc:330] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2: stopping tablet replica
I20260808 15:59:09.012683 9315 tablet_replica.cc:330] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b: stopping tablet replica
I20260808 15:59:09.013154 9315 raft_consensus.cc:2229] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:59:09.013576 9316 raft_consensus.cc:2229] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:59:09.014112 9316 raft_consensus.cc:2258] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:59:09.014503 9315 raft_consensus.cc:2258] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:59:09.016733 9315 ts_tablet_manager.cc:1905] T ff646b7e88d14e94a06ce976fb1c694b P 3873697dac4e40aa92a427fe99c60f9b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 15:59:09.016816 8424 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:37871 (error 108)
I20260808 15:59:09.017824 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 8784
I20260808 15:59:09.033381 9316 ts_tablet_manager.cc:1905] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:59:09.036589 9316 ts_tablet_manager.cc:1918] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:59:09.040221 9316 log.cc:1196] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/ff646b7e88d14e94a06ce976fb1c694b
I20260808 15:59:09.040657 9316 ts_tablet_manager.cc:1939] T ff646b7e88d14e94a06ce976fb1c694b P 52dc3b9a6e974450a75e9e494ce397d2: Deleting consensus metadata
I20260808 15:59:09.117619 8424 catalog_manager.cc:4841] TS 52dc3b9a6e974450a75e9e494ce397d2 (127.19.93.3:36177): tablet ff646b7e88d14e94a06ce976fb1c694b (table test-table [id=df60a757863d4737a8266f72cda9b61d]) successfully deleted
I20260808 15:59:09.117779 9274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:09.117342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:37871 (local address 127.0.0.1:56370)
0808 15:59:09.117567 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:09.117674 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:37871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
W20260808 15:59:09.118022 8424 catalog_manager.cc:4584] TS 70813ff08a8f4408aaa5147d75bc79a1 (127.19.93.1:37871): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ff646b7e88d14e94a06ce976fb1c694b: Network error: Client connection negotiation failed: client connection to 127.19.93.1:37871: connect: Connection refused (error 111)
I20260808 15:59:09.126485 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 9006
I20260808 15:59:09.126619 9274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:09.126294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:38815 (local address 127.0.0.1:45290)
0808 15:59:09.126480 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:09.126532 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.2:38815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260808 15:59:09.140626 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 8384
I20260808 15:59:09.154192 19828 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 15:59:09.511875 19828 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 15:59:09.511984 19828 mini_ranger.cc:66] Stopping Ranger...
I20260808 15:59:09.855262 19828 mini_ranger.cc:68] Stopped Ranger
2026-08-08 15:59:09.855 UTC [6872] LOG: received smart shutdown request
2026-08-08 15:59:09.859 UTC [6872] LOG: background worker "logical replication launcher" (PID 6889) exited with exit code 1
2026-08-08 15:59:09.859 UTC [6878] LOG: shutting down
2026-08-08 15:59:09.996 UTC [6872] LOG: database system is shut down
2026-08-08T15:59:09Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (45927 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:59:10 dist-test-slave-lgr5 krb5kdc[9339](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:59:10 dist-test-slave-lgr5 krb5kdc[9339](info): set up 2 sockets
Aug 08 15:59:10 dist-test-slave-lgr5 krb5kdc[9339](info): commencing operation
krb5kdc: starting...
W20260808 15:59:11.243707 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:59:11 dist-test-slave-lgr5 krb5kdc[9339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:59:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:59:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:59:11.358342 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:38015
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:35851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:38015,127.19.93.61:43883,127.19.93.60:43705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:11.464184 9360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:11.464403 9360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:11.464439 9360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:11.468235 9360 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:59:11.468274 9360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:11.468290 9360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:11.468309 9360 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:59:11.468327 9360 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:59:11.473219 9360 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:35851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:38015,127.19.93.61:43883,127.19.93.60:43705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:38015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:11.474056 9360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:11.474925 9360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:11.482801 9371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:11.482885 9360 server_base.cc:1034] running on GCE node
W20260808 15:59:11.482797 9369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:11.482811 9374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:11.483549 9360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:11.484669 9360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:11.485867 9360 hybrid_clock.cc:648] HybridClock initialized: now 1786204751485844 us; error 32 us; skew 500 ppm
Aug 08 15:59:11 dist-test-slave-lgr5 krb5kdc[9339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204751, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:11.488698 9360 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:59:11.489501 9360 webserver.cc:460] Webserver started at http://127.19.93.62:38421/ using document root <none> and password file <none>
I20260808 15:59:11.490013 9360 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:11.490080 9360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:11.490269 9360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:59:11.492225 9360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "0d0a6aa9e8034ceaaafcf1432eecd308"
format_stamp: "Formatted at 2026-08-08 15:59:11 on dist-test-slave-lgr5"
server_key: "6f441a34425b05bdcec1bdc299e3b7b3"
server_key_iv: "5b743b60c0ac35cc6649c5cbc637bf68"
server_key_version: "encryptionkey@0"
I20260808 15:59:11.492766 9360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "0d0a6aa9e8034ceaaafcf1432eecd308"
format_stamp: "Formatted at 2026-08-08 15:59:11 on dist-test-slave-lgr5"
server_key: "6f441a34425b05bdcec1bdc299e3b7b3"
server_key_iv: "5b743b60c0ac35cc6649c5cbc637bf68"
server_key_version: "encryptionkey@0"
I20260808 15:59:11.496233 9360 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:59:11.498546 9387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:11.499642 9360 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:11.499756 9360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "0d0a6aa9e8034ceaaafcf1432eecd308"
format_stamp: "Formatted at 2026-08-08 15:59:11 on dist-test-slave-lgr5"
server_key: "6f441a34425b05bdcec1bdc299e3b7b3"
server_key_iv: "5b743b60c0ac35cc6649c5cbc637bf68"
server_key_version: "encryptionkey@0"
I20260808 15:59:11.499845 9360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:11.541033 9360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:11.543581 9360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:11.543748 9360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:11.550401 9360 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:38015
I20260808 15:59:11.550422 9465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:38015 every 8 connection(s)
I20260808 15:59:11.551271 9360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:59:11.553714 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 9360
I20260808 15:59:11.553856 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:59:11.554018 9467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:11.554167 19828 external_mini_cluster.cc:1428] Setting key 456e301e68712f97e4eb97e8b3c99d99
I20260808 15:59:11.558071 9467 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.19.93.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.61@KRBTEST.COM" created.
Aug 08 15:59:11 dist-test-slave-lgr5 krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204751, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:11.572041 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.560262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:38015 (local address 127.0.0.1:45490)
0808 15:59:11.560768 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.560803 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:11.561546 (+ 743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:11.562145 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:11.562150 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:11.562537 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:11.562782 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:11.562796 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.563961 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.563963 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:11.564779 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:11.564789 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.565510 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.565514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:11.565620 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:11.566133 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:11.566148 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:11.567599 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:11.569368 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:11.569377 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:11.569385 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:11.569603 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:11.569889 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:11.569892 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:11.569893 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:11.569993 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:11.570514 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:11.570521 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:11.570633 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 15:59:11.570770 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 15:59:11.571175 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":110,"spinlock_wait_cycles":6528,"thread_start_us":137,"threads_started":1}
I20260808 15:59:11.572041 9470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.560261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45490 (local address 127.19.93.62:38015)
0808 15:59:11.560633 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:11.560650 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:11.560895 (+ 245us) server_negotiation.cc:407] Connection header received
0808 15:59:11.561810 (+ 915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:11.561815 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:11.561975 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:11.562129 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:11.562917 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.563840 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.564911 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.565348 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.565493 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:11.567727 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:11.567733 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:11.567742 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:11.567762 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:11.569271 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:11.569700 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:11.569706 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:11.569708 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:11.569805 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:11.570075 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:11.570079 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:11.570080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:11.570404 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:11.570516 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:11.570846 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 15:59:11.571118 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":245,"thread_start_us":104,"threads_started":1}
I20260808 15:59:11.574180 9467 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:59:11.574843 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.574589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:43883 (local address 127.0.0.1:39042)
0808 15:59:11.574693 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.574765 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:43883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 15:59:11.575016 9392 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.93.61:43883: connect: Connection refused (error 111)
I20260808 15:59:11.575806 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.575608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:43883 (local address 127.0.0.1:39054)
0808 15:59:11.575712 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.575757 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:43883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 15:59:11.575958 9467 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.61:43883: Network error: Client connection negotiation failed: client connection to 127.19.93.61:43883: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.61.keytab.
Entry for principal kudu/127.19.93.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.61.keytab.
I20260808 15:59:11.578341 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.61:43883
--webserver_interface=127.19.93.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.61.keytab
--principal=kudu/127.19.93.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:35851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:38015,127.19.93.61:43883,127.19.93.60:43705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:59:11.625201 9467 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } attempt: 1
I20260808 15:59:11.626050 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.625753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:43883 (local address 127.0.0.1:39058)
0808 15:59:11.625903 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.625963 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:43883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 15:59:11.626809 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.626617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:43883 (local address 127.0.0.1:39062)
0808 15:59:11.626706 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.626751 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:43883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 15:59:11.626935 9467 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.61:43883: Network error: Client connection negotiation failed: client connection to 127.19.93.61:43883: connect: Connection refused (error 111)
W20260808 15:59:11.686105 9478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:11.686345 9478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:11.686399 9478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:11.690263 9478 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:59:11.690310 9478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:11.690335 9478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:11.690356 9478 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:59:11.690383 9478 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:59:11.695101 9467 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } attempt: 2
I20260808 15:59:11.695398 9478 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:35851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:38015,127.19.93.61:43883,127.19.93.60:43705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.61.keytab
--principal=kudu/127.19.93.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.61:43883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.93.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:11.695958 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.695670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:43883 (local address 127.0.0.1:39068)
0808 15:59:11.695817 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.695881 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:43883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 15:59:11.696524 9478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:11.696652 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.696446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:43883 (local address 127.0.0.1:39072)
0808 15:59:11.696535 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.696578 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:43883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 15:59:11.696767 9467 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.61:43883: Network error: Client connection negotiation failed: client connection to 127.19.93.61:43883: connect: Connection refused (error 111)
I20260808 15:59:11.697525 9478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:11.705271 9486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:11.705276 9488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:11.705358 9493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:11.705556 9478 server_base.cc:1034] running on GCE node
I20260808 15:59:11.706050 9478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:11.707016 9478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:11.708130 9478 hybrid_clock.cc:648] HybridClock initialized: now 1786204751708098 us; error 50 us; skew 500 ppm
Aug 08 15:59:11 dist-test-slave-lgr5 krb5kdc[9339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204751, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:11.710709 9478 init.cc:377] Logged in from keytab as kudu/127.19.93.61@KRBTEST.COM (short username kudu)
I20260808 15:59:11.711496 9478 webserver.cc:460] Webserver started at http://127.19.93.61:41441/ using document root <none> and password file <none>
I20260808 15:59:11.711993 9478 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:11.712057 9478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:11.712260 9478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:59:11.714133 9478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/data/instance:
uuid: "19db745b2ac34d2fada9904afff65396"
format_stamp: "Formatted at 2026-08-08 15:59:11 on dist-test-slave-lgr5"
server_key: "99b59fea015ddbf1639665d1768ab5ab"
server_key_iv: "ec52ae35995dad413cf4c83e0c504a92"
server_key_version: "encryptionkey@0"
I20260808 15:59:11.714658 9478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/wal/instance:
uuid: "19db745b2ac34d2fada9904afff65396"
format_stamp: "Formatted at 2026-08-08 15:59:11 on dist-test-slave-lgr5"
server_key: "99b59fea015ddbf1639665d1768ab5ab"
server_key_iv: "ec52ae35995dad413cf4c83e0c504a92"
server_key_version: "encryptionkey@0"
I20260808 15:59:11.718084 9478 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:59:11.720238 9504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:11.721385 9478 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:11.721485 9478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/wal
uuid: "19db745b2ac34d2fada9904afff65396"
format_stamp: "Formatted at 2026-08-08 15:59:11 on dist-test-slave-lgr5"
server_key: "99b59fea015ddbf1639665d1768ab5ab"
server_key_iv: "ec52ae35995dad413cf4c83e0c504a92"
server_key_version: "encryptionkey@0"
I20260808 15:59:11.721585 9478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:11.744011 9478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:11.746893 9478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:11.747035 9478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:11.753471 9478 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.61:43883
I20260808 15:59:11.753487 9578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.61:43883 every 8 connection(s)
I20260808 15:59:11.754328 9478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/data/info.pb
I20260808 15:59:11.756929 9581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:11.760433 9581 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:59:11.763988 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 9478
I20260808 15:59:11.764122 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-1/wal/instance
I20260808 15:59:11.764364 19828 external_mini_cluster.cc:1428] Setting key b39fb5c02b77f1db49bc4ffb5ca09f81
Aug 08 15:59:11 dist-test-slave-lgr5 krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204751, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.61@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.93.60@KRBTEST.COM; defaulting to no policy
I20260808 15:59:11.772801 9470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.762060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45498 (local address 127.19.93.62:38015)
0808 15:59:11.762219 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:11.762223 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:11.762916 (+ 693us) server_negotiation.cc:407] Connection header received
0808 15:59:11.763712 (+ 796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:11.763715 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:11.763763 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:11.763842 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:11.765068 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.765595 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.766661 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.766893 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.766982 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:11.769474 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:11.769477 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:11.769479 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:11.769504 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:11.770755 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:11.771311 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:11.771313 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:11.771314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:11.771383 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:11.771721 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:11.771723 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:11.771724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:11.771881 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:11.771949 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:11.772571 (+ 622us) server_negotiation.cc:299] Negotiation successful
0808 15:59:11.772682 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 15:59:11.773566 9584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.762383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:38015 (local address 127.0.0.1:45498)
0808 15:59:11.762780 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.762818 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:11.763548 (+ 730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:11.764011 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:11.764017 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:11.764385 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:11.764922 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:11.764936 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.765716 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.765719 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:11.766542 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:11.766554 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.767028 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.767032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:11.767194 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:11.767676 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:11.767691 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:11.769311 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:11.770870 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:11.770876 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:11.770898 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:11.771221 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:11.771462 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:11.771465 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:11.771467 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:11.771636 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:11.771982 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:11.771989 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:11.772305 (+ 316us) client_negotiation.cc:769] Sending connection context
0808 15:59:11.772499 (+ 194us) client_negotiation.cc:240] Negotiation successful
0808 15:59:11.772807 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":100,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.60@KRBTEST.COM" created.
I20260808 15:59:11.774829 9581 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:59:11 dist-test-slave-lgr5 krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204751, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.61@KRBTEST.COM for kudu/127.19.93.61@KRBTEST.COM
I20260808 15:59:11.782693 9584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.775275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:43883 (local address 127.0.0.1:39084)
0808 15:59:11.775423 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.775434 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:11.775490 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:11.776005 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:11.776008 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:11.776181 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:11.776251 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:11.776257 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.777139 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.777142 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:11.777659 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:11.777667 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.778199 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.778202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:11.778285 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:11.778701 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:11.778712 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:11.779778 (+ 1066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:11.781421 (+ 1643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:11.781424 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:11.781426 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:11.781591 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:11.781836 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:11.781839 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:11.781841 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:11.781911 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:11.782288 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:11.782291 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:11.782371 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 15:59:11.782485 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 15:59:11.782588 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 15:59:11.782855 9588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.775388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39084 (local address 127.19.93.61:43883)
0808 15:59:11.775700 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:11.775707 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:11.775723 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:59:11.775753 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:11.775757 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:11.775896 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:11.776004 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:11.776348 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.777035 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.777758 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.778100 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.778189 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:11.779899 (+ 1710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:11.779909 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:11.779921 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:11.779940 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:11.781315 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:11.781683 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:11.781689 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:11.781690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:11.781757 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:11.781985 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:11.781988 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:11.781989 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:11.782193 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:11.782304 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:11.782580 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 15:59:11.782695 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":155,"threads_started":1}
I20260808 15:59:11.784585 9581 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:59:11.785182 9584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.784967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:43705 (local address 127.0.0.1:55138)
0808 15:59:11.785069 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.785132 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 15:59:11.785347 9505 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
I20260808 15:59:11.786087 9584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.785869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:43705 (local address 127.0.0.1:55146)
0808 15:59:11.785963 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.786012 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 15:59:11.786209 9581 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:43705: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.60.keytab.
Entry for principal kudu/127.19.93.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.60.keytab.
I20260808 15:59:11.787902 9467 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } attempt: 3
I20260808 15:59:11.788589 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.60:43705
--webserver_interface=127.19.93.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.60.keytab
--principal=kudu/127.19.93.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:35851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:38015,127.19.93.61:43883,127.19.93.60:43705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:59:11 dist-test-slave-lgr5 krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204751, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for kudu/127.19.93.61@KRBTEST.COM
I20260808 15:59:11.797183 9588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.788350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39094 (local address 127.19.93.61:43883)
0808 15:59:11.789688 (+ 1338us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:11.789691 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:11.789702 (+ 11us) server_negotiation.cc:407] Connection header received
0808 15:59:11.789729 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:11.789731 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:11.789763 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:11.789823 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:11.790268 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.790727 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.791986 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.792296 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.792386 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:11.794360 (+ 1974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:11.794364 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:11.794366 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:11.794387 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:11.795665 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:11.796139 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:11.796141 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:11.796142 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:11.796208 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:11.796479 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:11.796481 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:11.796482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:11.796625 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:11.796691 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:11.796994 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 15:59:11.797088 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1273}
I20260808 15:59:11.797216 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.788312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:43883 (local address 127.0.0.1:39094)
0808 15:59:11.788430 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.788443 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:11.788514 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:11.789874 (+ 1360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:11.789885 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:11.790054 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:11.790172 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:11.790180 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.790830 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.790834 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:11.791877 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:11.791889 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.792400 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.792403 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:11.792500 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:11.792893 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:11.792904 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:11.794236 (+ 1332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:11.795773 (+ 1537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:11.795776 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:11.795778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:11.796023 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:11.796286 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:11.796289 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:11.796291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:11.796401 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:11.796707 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:11.796710 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:11.796816 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 15:59:11.796925 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 15:59:11.797059 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 15:59:11.798283 9467 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:59:11.798905 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.798667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:43705 (local address 127.0.0.1:55150)
0808 15:59:11.798780 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.798835 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 15:59:11.799556 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.799322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:43705 (local address 127.0.0.1:55162)
0808 15:59:11.799455 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.799501 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260808 15:59:11.799666 9467 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:43705: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
I20260808 15:59:11.830821 9467 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } attempt: 1
I20260808 15:59:11.831557 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.831263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:43705 (local address 127.0.0.1:55172)
0808 15:59:11.831410 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.831474 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 15:59:11.832222 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.831984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:43705 (local address 127.0.0.1:55174)
0808 15:59:11.832105 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.832156 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 15:59:11.832347 9467 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:43705: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
I20260808 15:59:11.835410 9581 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } attempt: 1
I20260808 15:59:11.836009 9584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.835788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:43705 (local address 127.0.0.1:55178)
0808 15:59:11.835899 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.835948 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 15:59:11.836642 9584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.836441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:43705 (local address 127.0.0.1:55194)
0808 15:59:11.836543 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.836585 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 15:59:11.836776 9581 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:43705: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
W20260808 15:59:11.897511 9591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:11.897748 9591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:11.897804 9591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:11.901701 9591 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:59:11.901747 9591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:11.901772 9591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:11.901796 9591 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:59:11.901826 9591 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:59:11.904909 9581 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } attempt: 2
I20260808 15:59:11.905675 9584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.905403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:43705 (local address 127.0.0.1:55204)
0808 15:59:11.905540 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.905600 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 15:59:11.906345 9584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.906136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:43705 (local address 127.0.0.1:55216)
0808 15:59:11.906243 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.906288 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 15:59:11.906483 9581 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:43705: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
I20260808 15:59:11.907212 9591 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:35851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:38015,127.19.93.61:43883,127.19.93.60:43705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.60.keytab
--principal=kudu/127.19.93.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.60:43705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.93.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:11.907482 9467 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } attempt: 2
I20260808 15:59:11.908135 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.907843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:43705 (local address 127.0.0.1:55222)
0808 15:59:11.907971 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.908029 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 15:59:11.908365 9591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:11.908805 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.908617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:43705 (local address 127.0.0.1:55236)
0808 15:59:11.908698 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.908751 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 15:59:11.908917 9467 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:43705: Network error: Client connection negotiation failed: client connection to 127.19.93.60:43705: connect: Connection refused (error 111)
I20260808 15:59:11.909439 9591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:11.917222 9606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:11.917258 9608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:11.917253 9605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:11.917367 9591 server_base.cc:1034] running on GCE node
I20260808 15:59:11.917984 9591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:11.918967 9591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:11.920135 9591 hybrid_clock.cc:648] HybridClock initialized: now 1786204751920114 us; error 28 us; skew 500 ppm
Aug 08 15:59:11 dist-test-slave-lgr5 krb5kdc[9339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204751, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:11.922672 9591 init.cc:377] Logged in from keytab as kudu/127.19.93.60@KRBTEST.COM (short username kudu)
I20260808 15:59:11.923475 9591 webserver.cc:460] Webserver started at http://127.19.93.60:38465/ using document root <none> and password file <none>
I20260808 15:59:11.923965 9591 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:11.924028 9591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:11.924259 9591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:59:11.926247 9591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/data/instance:
uuid: "95e42dbc7574429680c7eaaec25b9dc9"
format_stamp: "Formatted at 2026-08-08 15:59:11 on dist-test-slave-lgr5"
server_key: "1fbbaff9ae612932a63b3503990d35a0"
server_key_iv: "7e992dd48dd695a62a6c21db230e4f7a"
server_key_version: "encryptionkey@0"
I20260808 15:59:11.926769 9591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/wal/instance:
uuid: "95e42dbc7574429680c7eaaec25b9dc9"
format_stamp: "Formatted at 2026-08-08 15:59:11 on dist-test-slave-lgr5"
server_key: "1fbbaff9ae612932a63b3503990d35a0"
server_key_iv: "7e992dd48dd695a62a6c21db230e4f7a"
server_key_version: "encryptionkey@0"
I20260808 15:59:11.930250 9591 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260808 15:59:11.932473 9621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:11.933552 9591 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:59:11.933662 9591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/wal
uuid: "95e42dbc7574429680c7eaaec25b9dc9"
format_stamp: "Formatted at 2026-08-08 15:59:11 on dist-test-slave-lgr5"
server_key: "1fbbaff9ae612932a63b3503990d35a0"
server_key_iv: "7e992dd48dd695a62a6c21db230e4f7a"
server_key_version: "encryptionkey@0"
I20260808 15:59:11.933748 9591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:11.952207 9591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:11.954762 9591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:11.954918 9591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:11.961263 9591 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.60:43705
I20260808 15:59:11.961275 9704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.60:43705 every 8 connection(s)
I20260808 15:59:11.962126 9591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/data/info.pb
I20260808 15:59:11.963699 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 9591
I20260808 15:59:11.963824 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786204595622323-19828-0/minicluster-data/master-2/wal/instance
I20260808 15:59:11.964164 19828 external_mini_cluster.cc:1428] Setting key 359185d3844b03188c111f29b3271f8a
I20260808 15:59:11.965068 9708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:11.968792 9708 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:59:11 dist-test-slave-lgr5 krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.60@KRBTEST.COM
Aug 08 15:59:11 dist-test-slave-lgr5 krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204751, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.60@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:11.979167 9712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.965445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55250 (local address 127.19.93.60:43705)
0808 15:59:11.965847 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:11.965861 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:11.965895 (+ 34us) server_negotiation.cc:407] Connection header received
0808 15:59:11.966505 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:11.966521 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:11.966833 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:11.967122 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:11.967894 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.968938 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.969799 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.970406 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.970579 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:11.973462 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:11.973469 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:11.973480 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:11.973510 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:11.975528 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:11.976040 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:11.976046 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:11.976052 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:11.976217 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:11.976533 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:11.976536 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:11.976538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:11.976897 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:11.977093 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:11.977880 (+ 787us) server_negotiation.cc:299] Negotiation successful
0808 15:59:11.978145 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":134,"threads_started":1}
I20260808 15:59:11.980531 9470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.970387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45506 (local address 127.19.93.62:38015)
0808 15:59:11.970503 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:11.970508 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:11.970901 (+ 393us) server_negotiation.cc:407] Connection header received
0808 15:59:11.971012 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:11.971015 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:11.971066 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:11.971226 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:11.971808 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.972413 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.973679 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.974004 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.974102 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:11.977008 (+ 2906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:11.977011 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:11.977014 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:11.977042 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:11.978604 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:11.979115 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:11.979118 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:11.979120 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:11.979212 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:11.979513 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:11.979516 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:11.979517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:11.979743 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:11.979814 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:11.980272 (+ 458us) server_negotiation.cc:299] Negotiation successful
0808 15:59:11.980390 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 15:59:11.980997 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.970334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:38015 (local address 127.0.0.1:45506)
0808 15:59:11.970737 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.970789 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:11.970914 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:11.971193 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:11.971198 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:11.971559 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:11.971681 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:11.971687 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.972545 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.972549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:11.973538 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:11.973550 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.974155 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.974160 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:11.974338 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:11.974782 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:11.974797 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:11.976859 (+ 2062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:11.978723 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:11.978729 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:11.978734 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:11.979000 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:11.979330 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:11.979333 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:11.979335 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:11.979414 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:11.979900 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:11.979905 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:11.980014 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 15:59:11.980711 (+ 697us) client_negotiation.cc:240] Negotiation successful
0808 15:59:11.980873 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":132,"threads_started":1}
I20260808 15:59:11.982008 9708 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:59:11 dist-test-slave-lgr5 krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
Aug 08 15:59:11 dist-test-slave-lgr5 krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204751, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.60@KRBTEST.COM for kudu/127.19.93.61@KRBTEST.COM
I20260808 15:59:11.994699 9470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.982185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45508 (local address 127.19.93.62:38015)
0808 15:59:11.982285 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:11.982288 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:11.982296 (+ 8us) server_negotiation.cc:407] Connection header received
0808 15:59:11.982322 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:11.982324 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:11.982353 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:11.982417 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:11.983026 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.983485 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.988445 (+ 4960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.988786 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.988895 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:11.991747 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:11.991751 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:11.991754 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:11.991780 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:11.993217 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:11.993605 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:11.993609 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:11.993611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:11.993689 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:11.993930 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:11.993934 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:11.993935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:11.994104 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:11.994316 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:11.994445 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 15:59:11.994550 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 15:59:11.995700 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.982424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:43883 (local address 127.0.0.1:39110)
0808 15:59:11.982684 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.982697 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:11.982762 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:11.988307 (+ 5545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:11.988309 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:11.988485 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:11.988599 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:11.988605 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.989645 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.989648 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:11.990464 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:11.990477 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.991046 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.991049 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:11.991122 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:11.991505 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:11.991516 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:11.992778 (+ 1262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:11.994286 (+ 1508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:11.994289 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:11.994292 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:11.994471 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:11.994754 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:11.994757 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:11.994759 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:11.994853 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:11.995251 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:11.995253 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:11.995331 (+ 78us) client_negotiation.cc:769] Sending connection context
0808 15:59:11.995431 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 15:59:11.995557 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200}
I20260808 15:59:11.995772 9588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.984204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39110 (local address 127.19.93.61:43883)
0808 15:59:11.987962 (+ 3758us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:11.987967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:11.987983 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:59:11.988030 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:11.988033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:11.988110 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:11.988186 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:11.988780 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.989507 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.990607 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.990934 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.991060 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:11.992910 (+ 1850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:11.992913 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:11.992915 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:11.992938 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:11.994183 (+ 1245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:11.994557 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:11.994560 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:11.994562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:11.994647 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:11.994938 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:11.994941 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:11.994942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:11.995152 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:11.995251 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:11.995566 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 15:59:11.995659 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3659}
I20260808 15:59:11.996519 9708 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:59:11.997639 9581 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } attempt: 3
Aug 08 15:59:11 dist-test-slave-lgr5 krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.61@KRBTEST.COM
Aug 08 15:59:11 dist-test-slave-lgr5 krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204751, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.60@KRBTEST.COM for kudu/127.19.93.60@KRBTEST.COM
Aug 08 15:59:11 dist-test-slave-lgr5 krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204751, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.61@KRBTEST.COM for kudu/127.19.93.60@KRBTEST.COM
I20260808 15:59:12.005162 9588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.996199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39126 (local address 127.19.93.61:43883)
0808 15:59:11.996288 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:11.996291 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:11.996304 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:59:11.996362 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:11.996365 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:11.996407 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:11.996476 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:11.997118 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.997575 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.998527 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.998760 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.998814 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:12.001075 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:12.001079 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:12.001081 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:12.001107 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:12.002994 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:12.003369 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:12.003372 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:12.003374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:12.003451 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:12.003729 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:12.003733 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:12.003735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:12.004000 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:12.004278 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:12.004651 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 15:59:12.004991 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 15:59:12.005194 9712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.997019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55254 (local address 127.19.93.60:43705)
0808 15:59:11.997105 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:11.997108 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:11.997122 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:59:11.997221 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:11.997223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:11.997256 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:11.997317 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:11.997647 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.998301 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.999199 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.999501 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.999584 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:12.001574 (+ 1990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:12.001577 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:12.001579 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:12.001604 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:12.003249 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:12.003771 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:12.003774 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:12.003776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:12.003851 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:12.004135 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:12.004138 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:12.004139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:12.004320 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:12.004430 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:12.004872 (+ 442us) server_negotiation.cc:299] Negotiation successful
0808 15:59:12.005015 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 15:59:12.005410 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.996977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:43705 (local address 127.0.0.1:55254)
0808 15:59:11.997079 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.997091 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:11.997158 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:11.997338 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:11.997341 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:11.997474 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:11.997534 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:11.997539 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.998405 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.998408 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:11.999099 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:11.999108 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:11.999709 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:11.999712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:11.999783 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:12.000193 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:12.000206 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:12.001458 (+ 1252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:12.003355 (+ 1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:12.003358 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:12.003360 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:12.003675 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:12.003928 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:12.003931 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:12.003932 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:12.004014 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:12.004424 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:12.004427 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:12.004676 (+ 249us) client_negotiation.cc:769] Sending connection context
0808 15:59:12.004797 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 15:59:12.004928 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 15:59:12.008065 9467 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } attempt: 3
I20260808 15:59:12.008471 9584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.997971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:43705 (local address 127.0.0.1:55256)
0808 15:59:11.998083 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:11.998096 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:11.998162 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:11.998718 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:11.998721 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:11.998882 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:11.998972 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:11.998978 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:12.000418 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:12.000422 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:12.001009 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:12.001021 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:12.001614 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:12.001617 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:12.001679 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:12.002232 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:12.002247 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:12.003754 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:12.006856 (+ 3102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:12.006860 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:12.006862 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:12.007090 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:12.007379 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:12.007383 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:12.007385 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:12.007479 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:12.007969 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:12.007972 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:12.008066 (+ 94us) client_negotiation.cc:769] Sending connection context
0808 15:59:12.008192 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 15:59:12.008320 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 15:59:12.008510 9714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:11.998161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55256 (local address 127.19.93.60:43705)
0808 15:59:11.998501 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:11.998509 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:11.998520 (+ 11us) server_negotiation.cc:407] Connection header received
0808 15:59:11.998548 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:11.998550 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:11.998586 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:11.999085 (+ 499us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:11.999164 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:12.000290 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:12.001156 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:12.001476 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:12.001603 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:12.003892 (+ 2289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:12.003896 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:12.003899 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:12.003920 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:12.006742 (+ 2822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:12.007208 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:12.007210 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:12.007212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:12.007289 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:12.007585 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:12.007589 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:12.007591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:12.007791 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:12.007884 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:12.008248 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 15:59:12.008345 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":110,"threads_started":1}
I20260808 15:59:12.009279 9708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9: Bootstrap starting.
I20260808 15:59:12.010802 9581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396: Bootstrap starting.
I20260808 15:59:12.011600 9708 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:12.012432 9708 log.cc:824] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:12.012989 9581 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:12.013844 9581 log.cc:824] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:12.014547 9708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9: No bootstrap required, opened a new log
I20260808 15:59:12.015571 9581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396: No bootstrap required, opened a new log
I20260808 15:59:12.016916 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
Aug 08 15:59:12 dist-test-slave-lgr5 krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204751, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for kudu/127.19.93.60@KRBTEST.COM
I20260808 15:59:12.018337 9708 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } }
I20260808 15:59:12.018550 9708 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:12.018636 9708 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95e42dbc7574429680c7eaaec25b9dc9, State: Initialized, Role: FOLLOWER
I20260808 15:59:12.019129 9708 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } }
I20260808 15:59:12.019256 9581 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } }
I20260808 15:59:12.019526 9581 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:12.019618 9581 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db745b2ac34d2fada9904afff65396, State: Initialized, Role: FOLLOWER
I20260808 15:59:12.020049 9581 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } }
I20260808 15:59:12.020746 9708 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:59:12.021394 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:12.008468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:43705 (local address 127.0.0.1:55272)
0808 15:59:12.012230 (+ 3762us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:12.012245 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:12.012332 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:12.012861 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:12.012865 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:12.013049 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:12.013164 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:12.013173 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:12.014558 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:12.014561 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:12.015328 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:12.015340 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:12.015893 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:12.015897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:12.015982 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:12.016444 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:12.016459 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:12.017893 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:12.019760 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:12.019763 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:12.019765 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:12.019998 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:12.020359 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:12.020363 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:12.020365 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:12.020456 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:12.020915 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:12.020918 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:12.021018 (+ 100us) client_negotiation.cc:769] Sending connection context
0808 15:59:12.021103 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 15:59:12.021234 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3667}
I20260808 15:59:12.021426 9581 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:59:12.021977 9714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:12.012534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55272 (local address 127.19.93.60:43705)
0808 15:59:12.012632 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:12.012636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:12.012648 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:59:12.012680 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:12.012683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:12.012721 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:12.013288 (+ 567us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:12.013374 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:12.014426 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:12.015458 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:12.015770 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:12.015890 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:12.018038 (+ 2148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:12.018042 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:12.018045 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:12.018069 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:12.019639 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:12.020166 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:12.020169 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:12.020171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:12.020250 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:12.020584 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:12.020588 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:12.020589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:12.020801 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:12.021658 (+ 857us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:12.021729 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 15:59:12.021840 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:59:12.024899 9467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308: Bootstrap starting.
W20260808 15:59:12.026760 9763 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:59:12.026824 9763 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:59:12.027446 9467 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:12.028954 9467 log.cc:824] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:12.032882 9588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:12.020433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39132 (local address 127.19.93.61:43883)
0808 15:59:12.020544 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:12.020548 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:12.024055 (+ 3507us) server_negotiation.cc:407] Connection header received
0808 15:59:12.024294 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:12.024298 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:12.024341 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:12.024415 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:12.025359 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:12.026056 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:12.027488 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:12.027791 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:12.027864 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:12.029535 (+ 1671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:12.029539 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:12.029542 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:12.029566 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:12.031094 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:12.031570 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:12.031574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:12.031575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:12.031664 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:12.031958 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:12.031961 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:12.031963 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:12.032194 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:12.032290 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:12.032641 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 15:59:12.032746 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 15:59:12.030193 9591 master_runner.cc:186] Error getting master registration for 127.19.93.62:38015: OK, instance_id { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" instance_seqno: 1786204751548447 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 15:59:12.033349 9591 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 15:59:12.024529 9724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } } }
I20260808 15:59:12.033715 9724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:59:12.030128 9478 master_runner.cc:186] Error getting master registration for 127.19.93.62:38015: OK, instance_id { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" instance_seqno: 1786204751548447 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 15:59:12.034394 9478 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 15:59:12.027181 9765 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 15:59:12.028455 9726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } } }
W20260808 15:59:12.034816 9765 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:59:12.034896 9726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:59:12.036659 9467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308: No bootstrap required, opened a new log
I20260808 15:59:12.037815 9714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:12.024054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55284 (local address 127.19.93.60:43705)
0808 15:59:12.028683 (+ 4629us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:12.028688 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:12.029571 (+ 883us) server_negotiation.cc:407] Connection header received
0808 15:59:12.029735 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:12.029738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:12.029778 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:12.029824 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:12.030608 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:12.031288 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:12.032417 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:12.032744 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:12.032814 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:12.034397 (+ 1583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:12.034400 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:12.034403 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:12.034426 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:12.035943 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:12.036444 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:12.036447 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:12.036449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:12.036534 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:12.036842 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:12.036845 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:12.036847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:12.037056 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:12.037204 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:12.037580 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 15:59:12.037688 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4559}
I20260808 15:59:12.042021 9467 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } }
I20260808 15:59:12.042302 9467 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:12.042367 9467 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d0a6aa9e8034ceaaafcf1432eecd308, State: Initialized, Role: FOLLOWER
I20260808 15:59:12.043025 9467 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } }
I20260808 15:59:12.044479 9467 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:59:12.045116 9470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:12.021135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45520 (local address 127.19.93.62:38015)
0808 15:59:12.021283 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:12.021287 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:12.027296 (+ 6009us) server_negotiation.cc:407] Connection header received
0808 15:59:12.027462 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:12.027465 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:12.027511 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:12.027592 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:12.028505 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:12.033540 (+ 5035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:12.034753 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:12.035042 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:12.035155 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:12.041465 (+ 6310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:12.041469 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:12.041472 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:12.041497 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:12.043086 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:12.043546 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:12.043549 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:12.043551 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:12.043635 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:12.043914 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:12.043917 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:12.043919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:12.044166 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:12.044279 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:12.044849 (+ 570us) server_negotiation.cc:299] Negotiation successful
0808 15:59:12.044964 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 15:59:12.045161 9395 tablet.cc:2369] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:59:12.052275 9771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } } }
I20260808 15:59:12.052392 9771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:59:12.054823 9360 master_runner.cc:263] No leader master found from master 0d0a6aa9e8034ceaaafcf1432eecd308
I20260808 15:59:12.054883 9360 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 15:59:12.055348 9785 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:59:12.055411 9785 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:59:12.170945 9726 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:59:12.171156 9726 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } }
I20260808 15:59:12.172570 9726 leader_election.cc:288] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d0a6aa9e8034ceaaafcf1432eecd308 (127.19.93.62:38015), 95e42dbc7574429680c7eaaec25b9dc9 (127.19.93.60:43705)
I20260808 15:59:12.173686 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "19db745b2ac34d2fada9904afff65396" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" is_pre_election: true
I20260808 15:59:12.174034 9424 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19db745b2ac34d2fada9904afff65396 in term 0.
I20260808 15:59:12.174587 9667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "19db745b2ac34d2fada9904afff65396" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95e42dbc7574429680c7eaaec25b9dc9" is_pre_election: true
I20260808 15:59:12.174886 9667 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19db745b2ac34d2fada9904afff65396 in term 0.
I20260808 15:59:12.175361 9505 leader_election.cc:302] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db745b2ac34d2fada9904afff65396, 95e42dbc7574429680c7eaaec25b9dc9; no voters:
I20260808 15:59:12.176124 9726 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:59:12.176214 9726 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:59:12.176261 9726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:12.177592 9726 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } }
I20260808 15:59:12.178279 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "19db745b2ac34d2fada9904afff65396" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308"
I20260808 15:59:12.178396 9424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:12.179601 9424 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db745b2ac34d2fada9904afff65396 in term 1.
I20260808 15:59:12.179982 9506 leader_election.cc:302] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d0a6aa9e8034ceaaafcf1432eecd308, 19db745b2ac34d2fada9904afff65396; no voters:
I20260808 15:59:12.180397 9726 leader_election.cc:288] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [CANDIDATE]: Term 1 election: Requested vote from peers 0d0a6aa9e8034ceaaafcf1432eecd308 (127.19.93.62:38015), 95e42dbc7574429680c7eaaec25b9dc9 (127.19.93.60:43705)
I20260808 15:59:12.180809 9667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "19db745b2ac34d2fada9904afff65396" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95e42dbc7574429680c7eaaec25b9dc9"
I20260808 15:59:12.180934 9667 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:12.182053 9667 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db745b2ac34d2fada9904afff65396 in term 1.
I20260808 15:59:12.182515 9726 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:59:12.182643 9726 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [term 1 LEADER]: Becoming Leader. State: Replica: 19db745b2ac34d2fada9904afff65396, State: Running, Role: LEADER
I20260808 15:59:12.183010 9726 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } }
I20260808 15:59:12.188045 9726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19db745b2ac34d2fada9904afff65396. Latest consensus state: current_term: 1 leader_uuid: "19db745b2ac34d2fada9904afff65396" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } } }
I20260808 15:59:12.188220 9726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:12.190029 9791 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:59:12.191067 9791 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:59:12.196513 9667 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9 [term 1 FOLLOWER]: Refusing update from remote peer 19db745b2ac34d2fada9904afff65396: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:59:12.197216 9789 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:59:12.201231 9724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19db745b2ac34d2fada9904afff65396. Latest consensus state: current_term: 1 leader_uuid: "19db745b2ac34d2fada9904afff65396" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } } }
I20260808 15:59:12.201340 9724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:59:12.202297 9424 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308 [term 1 FOLLOWER]: Refusing update from remote peer 19db745b2ac34d2fada9904afff65396: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:59:12.203006 9789 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 15:59:12.206144 9631 tablet.cc:2369] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:59:12.206604 9771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19db745b2ac34d2fada9904afff65396. Latest consensus state: current_term: 1 leader_uuid: "19db745b2ac34d2fada9904afff65396" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } } }
I20260808 15:59:12.206723 9771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:59:12.211683 9726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "19db745b2ac34d2fada9904afff65396" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } } }
I20260808 15:59:12.211786 9726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:12.212316 9771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "19db745b2ac34d2fada9904afff65396" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } } }
I20260808 15:59:12.212419 9771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:59:12.212868 9792 mvcc.cc:205] Tried to move back new op lower bound from 7316294664989442048 to 7316294664954167296. Current Snapshot: MvccSnapshot[applied={T|T < 7316294664989442048}]
I20260808 15:59:12.213189 9796 mvcc.cc:205] Tried to move back new op lower bound from 7316294664989442048 to 7316294664954167296. Current Snapshot: MvccSnapshot[applied={T|T < 7316294664989442048}]
I20260808 15:59:12.214077 9791 catalog_manager.cc:1347] Generated new cluster ID: e0918df8ca3d48248ac841e53f450eb0
I20260808 15:59:12.214131 9791 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:59:12.218281 9789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "19db745b2ac34d2fada9904afff65396" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } } }
I20260808 15:59:12.218386 9789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396 [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:12.219318 9724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "19db745b2ac34d2fada9904afff65396" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0a6aa9e8034ceaaafcf1432eecd308" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 38015 } } peers { permanent_uuid: "19db745b2ac34d2fada9904afff65396" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 43883 } } peers { permanent_uuid: "95e42dbc7574429680c7eaaec25b9dc9" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 43705 } } }
I20260808 15:59:12.219422 9724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:59:12.219723 9793 mvcc.cc:205] Tried to move back new op lower bound from 7316294664989442048 to 7316294664954167296. Current Snapshot: MvccSnapshot[applied={T|T < 7316294664989442048}]
I20260808 15:59:12.226653 9791 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:59:12.227877 9791 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:59:12.236222 9791 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19db745b2ac34d2fada9904afff65396: Generated new TSK 0
I20260808 15:59:12.237414 9791 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:59:13.036248 9765 catalog_manager.cc:1259] Loaded cluster ID: e0918df8ca3d48248ac841e53f450eb0
I20260808 15:59:13.036325 9765 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9: loading cluster ID for follower catalog manager: success
I20260808 15:59:13.038097 9765 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9: acquiring CA information for follower catalog manager: success
I20260808 15:59:13.039263 9765 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 95e42dbc7574429680c7eaaec25b9dc9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 15:59:13.056486 9785 catalog_manager.cc:1259] Loaded cluster ID: e0918df8ca3d48248ac841e53f450eb0
I20260808 15:59:13.056542 9785 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308: loading cluster ID for follower catalog manager: success
I20260808 15:59:13.058056 9785 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308: acquiring CA information for follower catalog manager: success
I20260808 15:59:13.059095 9785 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0d0a6aa9e8034ceaaafcf1432eecd308: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 15:59:13.296321 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 9360
I20260808 15:59:13.309437 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 9478
I20260808 15:59:13.322646 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 9591
2026-08-08T15:59:13Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3237 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:59:13 dist-test-slave-lgr5 krb5kdc[9817](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:59:13 dist-test-slave-lgr5 krb5kdc[9817](info): set up 2 sockets
Aug 08 15:59:13 dist-test-slave-lgr5 krb5kdc[9817](info): commencing operation
krb5kdc: starting...
W20260808 15:59:14.472280 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:59:14 dist-test-slave-lgr5 krb5kdc[9817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204754, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:59:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:59:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:59:14.587574 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:42531
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:35249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:42531
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:14.694574 9836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:14.694813 9836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:14.694864 9836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:14.698737 9836 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:59:14.698786 9836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:14.698812 9836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:14.698832 9836 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:59:14.698854 9836 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:59:14.703904 9836 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:35249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:42531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:42531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:14.704864 9836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:14.705792 9836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:14.713724 9848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:14.713784 9845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:14.713740 9846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:14.713816 9836 server_base.cc:1034] running on GCE node
I20260808 15:59:14.714605 9836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:14.715613 9836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:14.716796 9836 hybrid_clock.cc:648] HybridClock initialized: now 1786204754716770 us; error 36 us; skew 500 ppm
Aug 08 15:59:14 dist-test-slave-lgr5 krb5kdc[9817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204754, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:14.719331 9836 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:59:14.720158 9836 webserver.cc:460] Webserver started at http://127.19.93.62:36957/ using document root <none> and password file <none>
I20260808 15:59:14.720667 9836 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:14.720731 9836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:14.720906 9836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:59:14.722790 9836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "c14440896f384912a12a9a5f073dc6a7"
format_stamp: "Formatted at 2026-08-08 15:59:14 on dist-test-slave-lgr5"
server_key: "fe0cce11adc731c21eae750e2b575b55"
server_key_iv: "ce3b0871f836798aa36b8c0cad363d0d"
server_key_version: "encryptionkey@0"
I20260808 15:59:14.723305 9836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "c14440896f384912a12a9a5f073dc6a7"
format_stamp: "Formatted at 2026-08-08 15:59:14 on dist-test-slave-lgr5"
server_key: "fe0cce11adc731c21eae750e2b575b55"
server_key_iv: "ce3b0871f836798aa36b8c0cad363d0d"
server_key_version: "encryptionkey@0"
I20260808 15:59:14.726755 9836 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 15:59:14.729013 9860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:14.730114 9836 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:59:14.730235 9836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "c14440896f384912a12a9a5f073dc6a7"
format_stamp: "Formatted at 2026-08-08 15:59:14 on dist-test-slave-lgr5"
server_key: "fe0cce11adc731c21eae750e2b575b55"
server_key_iv: "ce3b0871f836798aa36b8c0cad363d0d"
server_key_version: "encryptionkey@0"
I20260808 15:59:14.730322 9836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:14.749363 9836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:14.752146 9836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:14.752300 9836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:14.758801 9836 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:42531
I20260808 15:59:14.758814 9948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:42531 every 8 connection(s)
I20260808 15:59:14.759641 9836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:59:14.762207 9949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:14.762478 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 9836
I20260808 15:59:14.762594 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:59:14.762831 19828 external_mini_cluster.cc:1428] Setting key d426e43b87ed1be834845f24017d717f
I20260808 15:59:14.768762 9949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7: Bootstrap starting.
I20260808 15:59:14.770992 9949 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7: Neither blocks nor log segments found. Creating new log.
Aug 08 15:59:14 dist-test-slave-lgr5 krb5kdc[9817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204754, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:14.771680 9949 log.cc:824] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:14.773762 9949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7: No bootstrap required, opened a new log
I20260808 15:59:14.776552 9952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:14.763983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57120 (local address 127.19.93.62:42531)
0808 15:59:14.764441 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:14.764458 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:14.764499 (+ 41us) server_negotiation.cc:407] Connection header received
0808 15:59:14.765218 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:14.765242 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:14.765628 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:14.765978 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:14.766587 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:14.768041 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:14.768857 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:14.769500 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:14.769654 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:14.771906 (+ 2252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:14.771912 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:14.771928 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:14.771960 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:14.773737 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:14.774159 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:14.774164 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:14.774170 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:14.774304 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:14.774523 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:14.774526 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:14.774528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:14.774993 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:14.775182 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:14.775360 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 15:59:14.775636 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":117,"threads_started":1}
I20260808 15:59:14.777944 9949 raft_consensus.cc:348] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c14440896f384912a12a9a5f073dc6a7" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42531 } }
I20260808 15:59:14.778159 9949 raft_consensus.cc:374] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:14.778270 9949 raft_consensus.cc:729] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c14440896f384912a12a9a5f073dc6a7, State: Initialized, Role: FOLLOWER
I20260808 15:59:14.778695 9949 consensus_queue.cc:260] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c14440896f384912a12a9a5f073dc6a7" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42531 } }
I20260808 15:59:14.778831 9949 raft_consensus.cc:388] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:59:14.778893 9949 raft_consensus.cc:482] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:59:14.778986 9949 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:14.779131 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:59:14.779804 9949 raft_consensus.cc:504] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c14440896f384912a12a9a5f073dc6a7" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42531 } }
I20260808 15:59:14.780157 9949 leader_election.cc:302] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c14440896f384912a12a9a5f073dc6a7; no voters:
I20260808 15:59:14.780452 9949 leader_election.cc:288] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:59:14.780548 9955 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:59:14.780795 9955 raft_consensus.cc:686] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [term 1 LEADER]: Becoming Leader. State: Replica: c14440896f384912a12a9a5f073dc6a7, State: Running, Role: LEADER
I20260808 15:59:14.781082 9955 consensus_queue.cc:237] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c14440896f384912a12a9a5f073dc6a7" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42531 } }
I20260808 15:59:14.781512 9949 sys_catalog.cc:564] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:59:14.782538 9957 sys_catalog.cc:455] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c14440896f384912a12a9a5f073dc6a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c14440896f384912a12a9a5f073dc6a7" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42531 } } }
I20260808 15:59:14.782662 9957 sys_catalog.cc:458] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:14.782948 9958 sys_catalog.cc:455] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c14440896f384912a12a9a5f073dc6a7. Latest consensus state: current_term: 1 leader_uuid: "c14440896f384912a12a9a5f073dc6a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c14440896f384912a12a9a5f073dc6a7" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 42531 } } }
I20260808 15:59:14.783041 9958 sys_catalog.cc:458] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7 [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:14.783018 9967 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:59:14.785688 9967 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:59:14.790235 9967 catalog_manager.cc:1347] Generated new cluster ID: 99e3379a6b214464a01f0ae3676198db
I20260808 15:59:14.790293 9967 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:59:14.800285 9967 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:59:14.801424 9967 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:59:14.812304 9967 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c14440896f384912a12a9a5f073dc6a7: Generated new TSK 0
I20260808 15:59:14.812973 9967 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:59:14.835332 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 9836
2026-08-08T15:59:14Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1511 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:59:14 dist-test-slave-lgr5 krb5kdc[9984](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:59:14 dist-test-slave-lgr5 krb5kdc[9984](info): set up 2 sockets
Aug 08 15:59:14 dist-test-slave-lgr5 krb5kdc[9984](info): commencing operation
krb5kdc: starting...
W20260808 15:59:15.985955 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:59:16 dist-test-slave-lgr5 krb5kdc[9984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204756, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:59:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:59:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:59:16.111784 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:36847
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:36847
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:16.217702 10010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:16.217942 10010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:16.217978 10010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:16.221751 10010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:59:16.221796 10010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:16.221813 10010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:16.221827 10010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:59:16.221846 10010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:59:16.226752 10010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:36847
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:36847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:16.227654 10010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:16.228590 10010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:16.236545 10019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:16.236544 10020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:16.236694 10010 server_base.cc:1034] running on GCE node
W20260808 15:59:16.236868 10022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:16.237376 10010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:16.238397 10010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:16.239558 10010 hybrid_clock.cc:648] HybridClock initialized: now 1786204756239548 us; error 28 us; skew 500 ppm
Aug 08 15:59:16 dist-test-slave-lgr5 krb5kdc[9984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204756, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:16.242102 10010 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:59:16.242923 10010 webserver.cc:460] Webserver started at http://127.19.93.62:37727/ using document root <none> and password file <none>
I20260808 15:59:16.243419 10010 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:16.243476 10010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:16.243662 10010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:59:16.245586 10010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "8dc897cf5bc3427692d13c9a6db9f988"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "1d5bed7d181e9764005af4280f2c34ad"
server_key_iv: "f3e4dd07814602c55c5541f443f57e98"
server_key_version: "encryptionkey@0"
I20260808 15:59:16.246104 10010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "8dc897cf5bc3427692d13c9a6db9f988"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "1d5bed7d181e9764005af4280f2c34ad"
server_key_iv: "f3e4dd07814602c55c5541f443f57e98"
server_key_version: "encryptionkey@0"
I20260808 15:59:16.249431 10010 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:59:16.251559 10032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:16.252696 10010 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:16.252799 10010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "8dc897cf5bc3427692d13c9a6db9f988"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "1d5bed7d181e9764005af4280f2c34ad"
server_key_iv: "f3e4dd07814602c55c5541f443f57e98"
server_key_version: "encryptionkey@0"
I20260808 15:59:16.252898 10010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:16.264427 10010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:16.266795 10010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:16.266961 10010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:16.273343 10010 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:36847
I20260808 15:59:16.273597 10115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:36847 every 8 connection(s)
I20260808 15:59:16.274211 10010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:59:16.276646 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 10010
I20260808 15:59:16.276787 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:59:16.276942 10116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:16.277109 19828 external_mini_cluster.cc:1428] Setting key 3771c7573234bd4e2a70de0225061e87
I20260808 15:59:16.283787 10116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988: Bootstrap starting.
Aug 08 15:59:16 dist-test-slave-lgr5 krb5kdc[9984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204756, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:16.286410 10116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:16.287083 10116 log.cc:824] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:16.289034 10116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988: No bootstrap required, opened a new log
I20260808 15:59:16.290351 10121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:16.278397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33664 (local address 127.19.93.62:36847)
0808 15:59:16.278768 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:16.278782 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:16.278815 (+ 33us) server_negotiation.cc:407] Connection header received
0808 15:59:16.279556 (+ 741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:16.279572 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:16.279869 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:16.280178 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:16.280998 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:16.281924 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:16.283076 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:16.283519 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:16.283630 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:16.286275 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:16.286280 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:16.286292 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:16.286317 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:16.287823 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:16.288273 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:16.288277 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:16.288282 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:16.288386 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:16.288654 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:16.288656 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:16.288657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:16.289009 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:16.289169 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:16.289425 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 15:59:16.289676 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":103,"threads_started":1}
I20260808 15:59:16.292786 10116 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } }
I20260808 15:59:16.292994 10116 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:16.293043 10116 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc897cf5bc3427692d13c9a6db9f988, State: Initialized, Role: FOLLOWER
I20260808 15:59:16.293427 10116 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } }
I20260808 15:59:16.293545 10116 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:59:16.293603 10116 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:59:16.293696 10116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:16.294582 10116 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } }
I20260808 15:59:16.294883 10116 leader_election.cc:302] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8dc897cf5bc3427692d13c9a6db9f988; no voters:
I20260808 15:59:16.295149 10116 leader_election.cc:288] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:59:16.295234 10125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:59:16.295437 10125 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc897cf5bc3427692d13c9a6db9f988, State: Running, Role: LEADER
I20260808 15:59:16.295770 10125 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } }
I20260808 15:59:16.296277 10116 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:59:16.297315 10127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8dc897cf5bc3427692d13c9a6db9f988. Latest consensus state: current_term: 1 leader_uuid: "8dc897cf5bc3427692d13c9a6db9f988" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } } }
I20260808 15:59:16.297452 10127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:16.297751 10126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8dc897cf5bc3427692d13c9a6db9f988" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } } }
I20260808 15:59:16.297907 10126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:16.298599 10137 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:59:16.301321 10137 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:59:16.306180 10137 catalog_manager.cc:1347] Generated new cluster ID: 71ad78f8dc4741919817280808da657d
I20260808 15:59:16.306241 10137 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:59:16.326620 10137 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:59:16.327539 10137 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:59:16.331092 10137 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988: Generated new TSK 0
I20260808 15:59:16.331703 10137 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 15:59:16.370672 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36847
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:16.491137 10153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:16.491364 10153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:16.491403 10153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:16.495256 10153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:16.495302 10153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:16.495355 10153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:59:16.500345 10153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:16.501281 10153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:16.502208 10153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:16.511159 10166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:16.511166 10164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:16.511382 10169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:16.511267 10153 server_base.cc:1034] running on GCE node
I20260808 15:59:16.511768 10153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:16.512382 10153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:16.513535 10153 hybrid_clock.cc:648] HybridClock initialized: now 1786204756513521 us; error 27 us; skew 500 ppm
Aug 08 15:59:16 dist-test-slave-lgr5 krb5kdc[9984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204756, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:16.516129 10153 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:59:16.516955 10153 webserver.cc:460] Webserver started at http://127.19.93.1:37517/ using document root <none> and password file <none>
I20260808 15:59:16.517450 10153 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:16.517513 10153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:16.517704 10153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:59:16.519579 10153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "3cba87db91c74ef3b05a725a3d686043"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "e54e2950dba3d0ba8ca1ec81e6554916"
server_key_iv: "42aa62da435a51f9ff375650433f7982"
server_key_version: "encryptionkey@0"
I20260808 15:59:16.520138 10153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "3cba87db91c74ef3b05a725a3d686043"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "e54e2950dba3d0ba8ca1ec81e6554916"
server_key_iv: "42aa62da435a51f9ff375650433f7982"
server_key_version: "encryptionkey@0"
I20260808 15:59:16.523411 10153 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:59:16.525600 10184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:16.526710 10153 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:59:16.526809 10153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "3cba87db91c74ef3b05a725a3d686043"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "e54e2950dba3d0ba8ca1ec81e6554916"
server_key_iv: "42aa62da435a51f9ff375650433f7982"
server_key_version: "encryptionkey@0"
I20260808 15:59:16.526904 10153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:16.537796 10153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:16.540617 10153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:16.540773 10153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:16.541303 10153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:16.542057 10153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:16.542102 10153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:16.542152 10153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:16.542181 10153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:16.549953 10153 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:34697
I20260808 15:59:16.549979 10347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:34697 every 8 connection(s)
I20260808 15:59:16.550726 10153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:59:16.557104 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 10153
I20260808 15:59:16.557225 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:59:16.557504 19828 external_mini_cluster.cc:1428] Setting key cf64037af189fa90a68bc6abcc7f633c
Aug 08 15:59:16 dist-test-slave-lgr5 krb5kdc[9984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204756, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:16.563997 10121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:16.552412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:35019 (local address 127.19.93.62:36847)
0808 15:59:16.552541 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:16.552544 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:16.553300 (+ 756us) server_negotiation.cc:407] Connection header received
0808 15:59:16.554635 (+ 1335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:16.554639 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:16.554699 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:16.554767 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:16.555950 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:16.556529 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:16.557730 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:16.558010 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:16.558093 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:16.560656 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:16.560659 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:16.560662 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:16.560687 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:16.561952 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:16.562489 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:16.562492 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:16.562493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:16.562580 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:16.562926 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:16.562928 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:16.562929 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:16.563089 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:16.563161 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:16.563740 (+ 579us) server_negotiation.cc:299] Negotiation successful
0808 15:59:16.563842 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:59:16.564967 10350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:16.552747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:35019)
0808 15:59:16.553163 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:16.553204 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:16.554436 (+ 1232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:16.554944 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:16.554951 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:16.555286 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:16.555806 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:16.555821 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:16.556674 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:16.556678 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:16.557611 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:16.557623 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:16.558152 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:16.558157 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:16.558319 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:16.558865 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:16.558883 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:16.560496 (+ 1613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:16.562062 (+ 1566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:16.562068 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:16.562082 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:16.562388 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:16.562663 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:16.562666 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:16.562668 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:16.562832 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:16.563182 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:16.563187 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:16.563462 (+ 275us) client_negotiation.cc:769] Sending connection context
0808 15:59:16.563686 (+ 224us) client_negotiation.cc:240] Negotiation successful
0808 15:59:16.564000 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":101,"threads_started":1}
I20260808 15:59:16.566123 10348 heartbeater.cc:347] Connected to a master server at 127.19.93.62:36847
I20260808 15:59:16.566330 10348 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:16.566762 10348 heartbeater.cc:511] Master 127.19.93.62:36847 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
I20260808 15:59:16.568243 10054 ts_manager.cc:194] Registered new tserver with Master: 3cba87db91c74ef3b05a725a3d686043 (127.19.93.1:34697)
I20260808 15:59:16.569350 10054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:35019
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 15:59:16.583953 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36847
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:16.693244 10354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:16.693486 10354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:16.693531 10354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:16.697507 10354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:16.697563 10354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:16.697646 10354 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:59:16.702694 10354 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:16.703666 10354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:16.704646 10354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:16.713913 10362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:16.713999 10361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:16.713907 10364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:16.714197 10354 server_base.cc:1034] running on GCE node
I20260808 15:59:16.714586 10354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:16.715157 10354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:16.716296 10354 hybrid_clock.cc:648] HybridClock initialized: now 1786204756716269 us; error 42 us; skew 500 ppm
Aug 08 15:59:16 dist-test-slave-lgr5 krb5kdc[9984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204756, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:16.718787 10354 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:59:16.719605 10354 webserver.cc:460] Webserver started at http://127.19.93.2:40569/ using document root <none> and password file <none>
I20260808 15:59:16.720150 10354 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:16.720220 10354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:16.720414 10354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:59:16.722295 10354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "6269efc962fe419ca4c25523595bb1bc"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "c9cf02b81714ff4d72a0f67792e64aee"
server_key_iv: "b05dc6454cc00d4cde96458e1f62daff"
server_key_version: "encryptionkey@0"
I20260808 15:59:16.722806 10354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "6269efc962fe419ca4c25523595bb1bc"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "c9cf02b81714ff4d72a0f67792e64aee"
server_key_iv: "b05dc6454cc00d4cde96458e1f62daff"
server_key_version: "encryptionkey@0"
I20260808 15:59:16.726203 10354 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:59:16.728367 10374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:16.729568 10354 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 15:59:16.729669 10354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "6269efc962fe419ca4c25523595bb1bc"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "c9cf02b81714ff4d72a0f67792e64aee"
server_key_iv: "b05dc6454cc00d4cde96458e1f62daff"
server_key_version: "encryptionkey@0"
I20260808 15:59:16.729753 10354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:16.749796 10354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:16.752403 10354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:16.752568 10354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:16.753087 10354 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:16.753834 10354 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:16.753881 10354 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:16.753930 10354 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:16.753959 10354 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:16.762115 10354 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:36767
I20260808 15:59:16.762161 10550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:36767 every 8 connection(s)
I20260808 15:59:16.762915 10354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:59:16.769934 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 10354
I20260808 15:59:16.770076 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:59:16.770643 19828 external_mini_cluster.cc:1428] Setting key e3e528923d3ed567588adc5db8cc60c4
Aug 08 15:59:16 dist-test-slave-lgr5 krb5kdc[9984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204756, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:16.775517 10121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:16.764512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:52561 (local address 127.19.93.62:36847)
0808 15:59:16.764643 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:16.764647 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:16.765403 (+ 756us) server_negotiation.cc:407] Connection header received
0808 15:59:16.766627 (+ 1224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:16.766630 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:16.766677 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:16.766747 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:16.767766 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:16.768342 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:16.769381 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:16.769600 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:16.769694 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:16.772257 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:16.772260 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:16.772262 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:16.772285 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:16.773565 (+ 1280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:16.774129 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:16.774133 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:16.774135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:16.774226 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:16.774526 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:16.774529 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:16.774530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:16.774744 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:16.774840 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:16.775264 (+ 424us) server_negotiation.cc:299] Negotiation successful
0808 15:59:16.775376 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 15:59:16.776221 10553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:16.764848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:52561)
0808 15:59:16.765265 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:16.765303 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:16.766453 (+ 1150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:16.766885 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:16.766893 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:16.767207 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:16.767656 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:16.767670 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:16.768442 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:16.768445 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:16.769277 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:16.769286 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:16.769720 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:16.769725 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:16.769917 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:16.770478 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:16.770497 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:16.772103 (+ 1606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:16.773680 (+ 1577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:16.773686 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:16.773698 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:16.774025 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:16.774307 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:16.774310 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:16.774311 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:16.774448 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:16.774826 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:16.774830 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:16.775033 (+ 203us) client_negotiation.cc:769] Sending connection context
0808 15:59:16.775186 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 15:59:16.775426 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":114,"threads_started":1}
I20260808 15:59:16.777247 10551 heartbeater.cc:347] Connected to a master server at 127.19.93.62:36847
I20260808 15:59:16.777485 10551 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:16.778050 10551 heartbeater.cc:511] Master 127.19.93.62:36847 requested a full tablet report, sending...
I20260808 15:59:16.779136 10054 ts_manager.cc:194] Registered new tserver with Master: 6269efc962fe419ca4c25523595bb1bc (127.19.93.2:36767)
I20260808 15:59:16.779675 10054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:52561
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 15:59:16.796440 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36847
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:16.901829 10556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:16.902065 10556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:16.902122 10556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:16.905951 10556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:16.905997 10556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:16.906078 10556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:59:16.911149 10556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:36847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:16.912031 10556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:16.912973 10556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:16.921837 10562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:16.921983 10556 server_base.cc:1034] running on GCE node
W20260808 15:59:16.921926 10566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:16.921847 10561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:16.922456 10556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:16.923020 10556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:16.924131 10556 hybrid_clock.cc:648] HybridClock initialized: now 1786204756924111 us; error 37 us; skew 500 ppm
Aug 08 15:59:16 dist-test-slave-lgr5 krb5kdc[9984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204756, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:16.926649 10556 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:59:16.927433 10556 webserver.cc:460] Webserver started at http://127.19.93.3:46203/ using document root <none> and password file <none>
I20260808 15:59:16.927925 10556 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:16.927984 10556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:16.928206 10556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:59:16.930145 10556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "4cd652a1e2634afc99ea40b528b55b06"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "06c8b2a4e98457c6d5f7f330c28113b9"
server_key_iv: "0d294482815b4c2a643454c3aff5b54d"
server_key_version: "encryptionkey@0"
I20260808 15:59:16.930661 10556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "4cd652a1e2634afc99ea40b528b55b06"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "06c8b2a4e98457c6d5f7f330c28113b9"
server_key_iv: "0d294482815b4c2a643454c3aff5b54d"
server_key_version: "encryptionkey@0"
I20260808 15:59:16.934273 10556 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:59:16.936414 10577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:16.937511 10556 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:59:16.937604 10556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "4cd652a1e2634afc99ea40b528b55b06"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "06c8b2a4e98457c6d5f7f330c28113b9"
server_key_iv: "0d294482815b4c2a643454c3aff5b54d"
server_key_version: "encryptionkey@0"
I20260808 15:59:16.937691 10556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:16.950917 10556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:16.953284 10556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:16.953444 10556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:16.953938 10556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:16.954665 10556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:16.954710 10556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:16.954748 10556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:16.954777 10556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:16.963160 10556 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:38607
I20260808 15:59:16.963192 10749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:38607 every 8 connection(s)
I20260808 15:59:16.963932 10556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:59:16.971661 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 10556
I20260808 15:59:16.971792 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:59:16.972110 19828 external_mini_cluster.cc:1428] Setting key 2ce2988ec3ae7decffddd91ae8ab3993
Aug 08 15:59:16 dist-test-slave-lgr5 krb5kdc[9984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204756, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:16.976706 10121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:16.965534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:52811 (local address 127.19.93.62:36847)
0808 15:59:16.965655 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:16.965658 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:16.966373 (+ 715us) server_negotiation.cc:407] Connection header received
0808 15:59:16.967650 (+ 1277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:16.967654 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:16.967715 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:16.967786 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:16.968933 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:16.969459 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:16.970582 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:16.970798 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:16.970886 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:16.973403 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:16.973406 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:16.973408 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:16.973433 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:16.974805 (+ 1372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:16.975276 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:16.975279 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:16.975281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:16.975359 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:16.975666 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:16.975669 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:16.975671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:16.975842 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:16.975928 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:16.976436 (+ 508us) server_negotiation.cc:299] Negotiation successful
0808 15:59:16.976553 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 15:59:16.977371 10752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:16.965828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:52811)
0808 15:59:16.966239 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:16.966278 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:16.967443 (+ 1165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:16.967958 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:16.967965 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:16.968335 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:16.968784 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:16.968797 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:16.969583 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:16.969586 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:16.970450 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:16.970460 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:16.970934 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:16.970938 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:16.971094 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:16.971621 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:16.971642 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:16.973262 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:16.974918 (+ 1656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:16.974924 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:16.974937 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:16.975184 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:16.975449 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:16.975452 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:16.975454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:16.975579 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:16.975948 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:16.975954 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:16.976208 (+ 254us) client_negotiation.cc:769] Sending connection context
0808 15:59:16.976365 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 15:59:16.976655 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":97,"threads_started":1}
I20260808 15:59:16.978305 10750 heartbeater.cc:347] Connected to a master server at 127.19.93.62:36847
I20260808 15:59:16.978508 10750 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:16.978930 10750 heartbeater.cc:511] Master 127.19.93.62:36847 requested a full tablet report, sending...
I20260808 15:59:16.979835 10054 ts_manager.cc:194] Registered new tserver with Master: 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3:38607)
I20260808 15:59:16.980397 10054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:52811
I20260808 15:59:16.985637 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:59:16.994305 10121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:16.987471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33680 (local address 127.19.93.62:36847)
0808 15:59:16.987579 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:16.987582 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:16.987767 (+ 185us) server_negotiation.cc:407] Connection header received
0808 15:59:16.987859 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:16.987862 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:16.987905 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:16.987966 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:16.988616 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:16.989190 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:16.990255 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:16.990474 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:16.990558 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:16.991737 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:16.991741 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:16.991744 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:16.991769 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:16.992826 (+ 1057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:16.993203 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:16.993206 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:16.993208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:16.993280 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:16.993525 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:16.993529 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:16.993530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:16.993728 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:16.993842 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:16.994064 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 15:59:16.994168 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 15:59:16.996869 10054 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33680:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:59:16.999853 10054 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:59:17.013788 10778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.008645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59916 (local address 127.19.93.2:36767)
0808 15:59:17.008962 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:17.008972 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:17.009421 (+ 449us) server_negotiation.cc:407] Connection header received
0808 15:59:17.009494 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:17.009498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:17.009644 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:17.009775 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:17.009990 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.010741 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.012597 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.013145 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.013244 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.013391 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:17.013554 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 15:59:17.013654 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":145,"threads_started":1}
I20260808 15:59:17.013774 10773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.008453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:36767 (local address 127.0.0.1:59916)
0808 15:59:17.009232 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:17.009243 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:17.009316 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:17.009773 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:17.009776 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:17.009793 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:17.009879 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:17.009885 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.010857 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.010860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:17.012459 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:17.012471 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.013257 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.013261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:17.013366 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.013418 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 15:59:17.013515 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 15:59:17.013634 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":729,"mutex_wait_us":161,"thread_start_us":84,"threads_started":1}
I20260808 15:59:17.013974 10771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.007746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:34697 (local address 127.0.0.1:50980)
0808 15:59:17.008097 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:17.008142 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:17.008260 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:17.009351 (+ 1091us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:17.009357 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:17.009384 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:17.009495 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:17.009500 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.011021 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.011024 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:17.012469 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:17.012476 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.013585 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.013588 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:17.013682 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.013706 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:59:17.013772 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 15:59:17.013843 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":136,"thread_start_us":72,"threads_started":1}
I20260808 15:59:17.014142 10777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.008446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58828 (local address 127.19.93.3:38607)
0808 15:59:17.008760 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:17.008771 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:17.009162 (+ 391us) server_negotiation.cc:407] Connection header received
0808 15:59:17.009382 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:17.009387 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:17.009564 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:17.009683 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:17.010117 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.011149 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.012448 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.013260 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.013372 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.013512 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:17.013903 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 15:59:17.013996 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":125,"threads_started":1}
I20260808 15:59:17.014465 10775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.008013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:38607 (local address 127.0.0.1:58828)
0808 15:59:17.009061 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:17.009074 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:17.009232 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:17.009867 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:17.009870 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:17.009898 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:17.009997 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:17.010003 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.011269 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.011272 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:17.012333 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:17.012342 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.013685 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.013689 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:17.013763 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.013783 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 15:59:17.014273 (+ 490us) client_negotiation.cc:240] Negotiation successful
0808 15:59:17.014348 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":988,"mutex_wait_us":1,"thread_start_us":120,"threads_started":1}
I20260808 15:59:17.014508 10772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.007900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50980 (local address 127.19.93.1:34697)
0808 15:59:17.008873 (+ 973us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:17.008883 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:17.008907 (+ 24us) server_negotiation.cc:407] Connection header received
0808 15:59:17.008986 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:17.008991 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:17.009168 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:17.009632 (+ 464us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:17.009775 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.010894 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.012585 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.013327 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.013409 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.013516 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:17.014296 (+ 780us) server_negotiation.cc:299] Negotiation successful
0808 15:59:17.014385 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":882,"thread_start_us":140,"threads_started":1}
I20260808 15:59:17.017216 10247 tablet_service.cc:1467] Processing CreateTablet for tablet c41d7b0a40e247fbbd788a4c5fd051c0 (DEFAULT_TABLE table=test-table [id=706eb6e4889f4b6c9154fd3f142596ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:59:17.017077 10444 tablet_service.cc:1467] Processing CreateTablet for tablet c41d7b0a40e247fbbd788a4c5fd051c0 (DEFAULT_TABLE table=test-table [id=706eb6e4889f4b6c9154fd3f142596ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:59:17.017479 10654 tablet_service.cc:1467] Processing CreateTablet for tablet c41d7b0a40e247fbbd788a4c5fd051c0 (DEFAULT_TABLE table=test-table [id=706eb6e4889f4b6c9154fd3f142596ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:59:17.018141 10247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c41d7b0a40e247fbbd788a4c5fd051c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:17.018153 10444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c41d7b0a40e247fbbd788a4c5fd051c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:17.018344 10654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c41d7b0a40e247fbbd788a4c5fd051c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:17.025013 10779 tablet_bootstrap.cc:492] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: Bootstrap starting.
I20260808 15:59:17.025786 10781 tablet_bootstrap.cc:492] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc: Bootstrap starting.
I20260808 15:59:17.027024 10779 tablet_bootstrap.cc:654] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:17.027854 10781 tablet_bootstrap.cc:654] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:17.028064 10779 log.cc:824] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:17.028395 10782 tablet_bootstrap.cc:492] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06: Bootstrap starting.
I20260808 15:59:17.028683 10781 log.cc:824] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:17.030177 10779 tablet_bootstrap.cc:492] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: No bootstrap required, opened a new log
I20260808 15:59:17.030361 10779 ts_tablet_manager.cc:1397] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260808 15:59:17.030426 10782 tablet_bootstrap.cc:654] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:17.030617 10781 tablet_bootstrap.cc:492] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc: No bootstrap required, opened a new log
I20260808 15:59:17.030807 10781 ts_tablet_manager.cc:1397] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 15:59:17.031759 10782 log.cc:824] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:17.033618 10782 tablet_bootstrap.cc:492] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06: No bootstrap required, opened a new log
I20260808 15:59:17.033546 10779 raft_consensus.cc:348] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } } peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } }
I20260808 15:59:17.033805 10779 raft_consensus.cc:374] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:17.033881 10779 raft_consensus.cc:729] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cba87db91c74ef3b05a725a3d686043, State: Initialized, Role: FOLLOWER
I20260808 15:59:17.034047 10782 ts_tablet_manager.cc:1397] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.002s
I20260808 15:59:17.034286 10779 consensus_queue.cc:260] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } } peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } }
I20260808 15:59:17.034502 10781 raft_consensus.cc:348] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } } peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } }
I20260808 15:59:17.034789 10781 raft_consensus.cc:374] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:17.034866 10348 heartbeater.cc:503] Master 127.19.93.62:36847 was elected leader, sending a full tablet report...
I20260808 15:59:17.034893 10781 raft_consensus.cc:729] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6269efc962fe419ca4c25523595bb1bc, State: Initialized, Role: FOLLOWER
I20260808 15:59:17.035245 10779 ts_tablet_manager.cc:1428] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260808 15:59:17.035473 10781 consensus_queue.cc:260] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } } peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } }
I20260808 15:59:17.036417 10781 ts_tablet_manager.cc:1428] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 15:59:17.036749 10551 heartbeater.cc:503] Master 127.19.93.62:36847 was elected leader, sending a full tablet report...
I20260808 15:59:17.037647 10782 raft_consensus.cc:348] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } } peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } }
I20260808 15:59:17.037894 10782 raft_consensus.cc:374] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:17.037952 10782 raft_consensus.cc:729] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cd652a1e2634afc99ea40b528b55b06, State: Initialized, Role: FOLLOWER
I20260808 15:59:17.038343 10782 consensus_queue.cc:260] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } } peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } }
I20260808 15:59:17.038982 10750 heartbeater.cc:503] Master 127.19.93.62:36847 was elected leader, sending a full tablet report...
I20260808 15:59:17.039201 10782 ts_tablet_manager.cc:1428] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
W20260808 15:59:17.051743 10349 tablet.cc:2369] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:59:17.137790 10790 raft_consensus.cc:482] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:59:17.137986 10790 raft_consensus.cc:504] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } } peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } }
I20260808 15:59:17.139144 10790 leader_election.cc:288] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cba87db91c74ef3b05a725a3d686043 (127.19.93.1:34697), 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3:38607)
I20260808 15:59:17.142899 10777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.139567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:58637 (local address 127.19.93.3:38607)
0808 15:59:17.139687 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:17.139692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:17.139870 (+ 178us) server_negotiation.cc:407] Connection header received
0808 15:59:17.139976 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:17.139979 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:17.140027 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:17.140151 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:17.140394 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.140921 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.141952 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.142373 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.142459 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.142523 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:17.142701 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 15:59:17.142772 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 15:59:17.142892 10792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.139406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:38607 (local address 127.19.93.2:58637)
0808 15:59:17.139789 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:17.139802 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:17.139889 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:17.140164 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:17.140166 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:17.140184 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:17.140298 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:17.140305 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.141030 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.141033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:17.141833 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:17.141844 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.142486 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.142490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:17.142583 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.142608 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 15:59:17.142668 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 15:59:17.142733 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":134,"threads_started":1}
I20260808 15:59:17.142923 10772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.139523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:33357 (local address 127.19.93.1:34697)
0808 15:59:17.139659 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:17.139664 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:17.139677 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:59:17.139730 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:17.139733 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:17.139780 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:17.139864 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:17.140170 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.140794 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.141901 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.142396 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.142494 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.142567 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:17.142751 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 15:59:17.142823 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:59:17.142899 10553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.139321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:34697 (local address 127.19.93.2:33357)
0808 15:59:17.139438 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:17.139453 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:17.139546 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:17.139892 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:17.139896 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:17.139919 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:17.140053 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:17.140059 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.140903 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.140907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:17.141769 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:17.141780 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.142514 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.142518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:17.142631 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.142649 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 15:59:17.142723 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 15:59:17.142793 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 15:59:17.143560 10276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c41d7b0a40e247fbbd788a4c5fd051c0" candidate_uuid: "6269efc962fe419ca4c25523595bb1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cba87db91c74ef3b05a725a3d686043" is_pre_election: true
I20260808 15:59:17.143622 10685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c41d7b0a40e247fbbd788a4c5fd051c0" candidate_uuid: "6269efc962fe419ca4c25523595bb1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd652a1e2634afc99ea40b528b55b06" is_pre_election: true
I20260808 15:59:17.143838 10276 raft_consensus.cc:2454] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6269efc962fe419ca4c25523595bb1bc in term 0.
I20260808 15:59:17.143893 10685 raft_consensus.cc:2454] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6269efc962fe419ca4c25523595bb1bc in term 0.
I20260808 15:59:17.144345 10379 leader_election.cc:302] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cd652a1e2634afc99ea40b528b55b06, 6269efc962fe419ca4c25523595bb1bc; no voters:
I20260808 15:59:17.144627 10790 raft_consensus.cc:2781] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:59:17.144706 10790 raft_consensus.cc:482] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:59:17.144734 10790 raft_consensus.cc:3037] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:17.145713 10790 raft_consensus.cc:504] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } } peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } }
I20260808 15:59:17.146044 10790 leader_election.cc:288] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [CANDIDATE]: Term 1 election: Requested vote from peers 3cba87db91c74ef3b05a725a3d686043 (127.19.93.1:34697), 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3:38607)
I20260808 15:59:17.146384 10685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c41d7b0a40e247fbbd788a4c5fd051c0" candidate_uuid: "6269efc962fe419ca4c25523595bb1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd652a1e2634afc99ea40b528b55b06"
I20260808 15:59:17.146378 10276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c41d7b0a40e247fbbd788a4c5fd051c0" candidate_uuid: "6269efc962fe419ca4c25523595bb1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cba87db91c74ef3b05a725a3d686043"
I20260808 15:59:17.146497 10685 raft_consensus.cc:3037] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:17.146497 10276 raft_consensus.cc:3037] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:17.147708 10276 raft_consensus.cc:2454] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6269efc962fe419ca4c25523595bb1bc in term 1.
I20260808 15:59:17.147708 10685 raft_consensus.cc:2454] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6269efc962fe419ca4c25523595bb1bc in term 1.
I20260808 15:59:17.147989 10378 leader_election.cc:302] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3cba87db91c74ef3b05a725a3d686043, 4cd652a1e2634afc99ea40b528b55b06, 6269efc962fe419ca4c25523595bb1bc; no voters:
I20260808 15:59:17.148180 10790 raft_consensus.cc:2781] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:59:17.148383 10790 raft_consensus.cc:686] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [term 1 LEADER]: Becoming Leader. State: Replica: 6269efc962fe419ca4c25523595bb1bc, State: Running, Role: LEADER
I20260808 15:59:17.148672 10790 consensus_queue.cc:237] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } } peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } }
I20260808 15:59:17.151640 10053 catalog_manager.cc:5495] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6269efc962fe419ca4c25523595bb1bc (127.19.93.2). New cstate: current_term: 1 leader_uuid: "6269efc962fe419ca4c25523595bb1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260808 15:59:17.161777 10778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.158812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59932 (local address 127.19.93.2:36767)
0808 15:59:17.158909 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:17.158912 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:17.158940 (+ 28us) server_negotiation.cc:407] Connection header received
0808 15:59:17.159109 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:17.159111 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:17.159159 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:17.159241 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:59:17.159413 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.159869 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.160666 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.160864 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.160934 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.161144 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:59:17.161515 (+ 371us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:59:17.161597 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:17.161623 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 15:59:17.161665 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 15:59:17.166962 10276 raft_consensus.cc:1261] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Refusing update from remote peer 6269efc962fe419ca4c25523595bb1bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:59:17.166963 10685 raft_consensus.cc:1261] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06 [term 1 FOLLOWER]: Refusing update from remote peer 6269efc962fe419ca4c25523595bb1bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:59:17.167613 10793 consensus_queue.cc:1035] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:59:17.167766 10790 consensus_queue.cc:1035] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:59:17.176594 10797 mvcc.cc:205] Tried to move back new op lower bound from 7316294685349482496 to 7316294685283409920. Current Snapshot: MvccSnapshot[applied={T|T < 7316294685349482496}]
I20260808 15:59:17.181676 10053 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:59:17.181850 10053 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:59:17.184212 10053 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988: Sending DeleteTablet for 3 replicas of tablet c41d7b0a40e247fbbd788a4c5fd051c0
I20260808 15:59:17.184957 10247 tablet_service.cc:1514] Processing DeleteTablet for tablet c41d7b0a40e247fbbd788a4c5fd051c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:59:17 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:50980
I20260808 15:59:17.185143 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 10153
I20260808 15:59:17.185127 10654 tablet_service.cc:1514] Processing DeleteTablet for tablet c41d7b0a40e247fbbd788a4c5fd051c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:59:17 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:58828
I20260808 15:59:17.188140 10819 tablet_replica.cc:330] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06: stopping tablet replica
I20260808 15:59:17.188452 10819 raft_consensus.cc:2229] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:59:17.188746 10819 raft_consensus.cc:2258] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:59:17.191764 10819 ts_tablet_manager.cc:1905] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:59:17.194101 10819 ts_tablet_manager.cc:1918] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:59:17.194195 10819 log.cc:1196] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/c41d7b0a40e247fbbd788a4c5fd051c0
I20260808 15:59:17.194504 10819 ts_tablet_manager.cc:1939] T c41d7b0a40e247fbbd788a4c5fd051c0 P 4cd652a1e2634afc99ea40b528b55b06: Deleting consensus metadata
I20260808 15:59:17.195647 10036 catalog_manager.cc:4841] TS 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3:38607): tablet c41d7b0a40e247fbbd788a4c5fd051c0 (table test-table [id=706eb6e4889f4b6c9154fd3f142596ff]) successfully deleted
I20260808 15:59:17.200589 10444 tablet_service.cc:1514] Processing DeleteTablet for tablet c41d7b0a40e247fbbd788a4c5fd051c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:59:17 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:59916
I20260808 15:59:17.201150 10820 tablet_replica.cc:330] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc: stopping tablet replica
I20260808 15:59:17.201473 10820 raft_consensus.cc:2229] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:59:17.201831 10820 raft_consensus.cc:2258] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:59:17.203311 10820 ts_tablet_manager.cc:1905] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:59:17.205932 10820 ts_tablet_manager.cc:1918] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:59:17.206028 10820 log.cc:1196] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/c41d7b0a40e247fbbd788a4c5fd051c0
W20260808 15:59:17.206141 10035 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:34697 (error 108)
I20260808 15:59:17.206337 10820 ts_tablet_manager.cc:1939] T c41d7b0a40e247fbbd788a4c5fd051c0 P 6269efc962fe419ca4c25523595bb1bc: Deleting consensus metadata
I20260808 15:59:17.206450 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 10354
I20260808 15:59:17.214197 10775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.213894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:34697 (local address 127.0.0.1:50990)
0808 15:59:17.214056 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:17.214118 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:34697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260808 15:59:17.214425 10035 catalog_manager.cc:4584] TS 3cba87db91c74ef3b05a725a3d686043 (127.19.93.1:34697): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c41d7b0a40e247fbbd788a4c5fd051c0: Network error: Client connection negotiation failed: client connection to 127.19.93.1:34697: connect: Connection refused (error 111)
I20260808 15:59:17.219117 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 10556
I20260808 15:59:17.224002 10775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.223767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:36767 (local address 127.0.0.1:59940)
0808 15:59:17.223883 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:17.223935 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.2:36767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 15:59:17.227813 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 10010
I20260808 15:59:17.236928 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:36847
--webserver_interface=127.19.93.62
--webserver_port=37727
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:36847
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:17.343698 10825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:17.343920 10825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:17.343961 10825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:17.347792 10825 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:59:17.347841 10825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:17.347862 10825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:17.347889 10825 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:59:17.347915 10825 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:59:17.352844 10825 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:36847
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:36847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=37727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:17.353777 10825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:17.354692 10825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:17.368440 10839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:17.368479 10841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:17.368502 10838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:17.368553 10825 server_base.cc:1034] running on GCE node
I20260808 15:59:17.369168 10825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:17.370220 10825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:17.371376 10825 hybrid_clock.cc:648] HybridClock initialized: now 1786204757371362 us; error 30 us; skew 500 ppm
Aug 08 15:59:17 dist-test-slave-lgr5 krb5kdc[9984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204757, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:17.374306 10825 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:59:17.375134 10825 webserver.cc:460] Webserver started at http://127.19.93.62:37727/ using document root <none> and password file <none>
I20260808 15:59:17.375648 10825 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:17.375711 10825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:17.379311 10825 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:17.381353 10850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:17.382462 10825 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:59:17.382563 10825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "8dc897cf5bc3427692d13c9a6db9f988"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "1d5bed7d181e9764005af4280f2c34ad"
server_key_iv: "f3e4dd07814602c55c5541f443f57e98"
server_key_version: "encryptionkey@0"
I20260808 15:59:17.383111 10825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:17.405961 10825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:17.408449 10825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:17.408599 10825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:17.415205 10825 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:36847
I20260808 15:59:17.415459 10941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:36847 every 8 connection(s)
I20260808 15:59:17.416265 10825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:59:17.420508 10942 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:59:17.422102 10942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988: Bootstrap starting.
I20260808 15:59:17.422572 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 10825
I20260808 15:59:17.423058 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:34697
--local_ip_for_outbound_sockets=127.19.93.1
--tserver_master_addrs=127.19.93.62:36847
--webserver_port=37517
--webserver_interface=127.19.93.1
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:59:17.439473 10942 log.cc:824] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:17.448719 10942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:59:17.449070 10942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988: Bootstrap complete.
I20260808 15:59:17.452986 10942 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } }
I20260808 15:59:17.453392 10942 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc897cf5bc3427692d13c9a6db9f988, State: Initialized, Role: FOLLOWER
I20260808 15:59:17.453859 10942 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } }
I20260808 15:59:17.453977 10942 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:59:17.454053 10942 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:59:17.454145 10942 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 1 FOLLOWER]: Advancing to term 2
I20260808 15:59:17.456022 10942 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } }
I20260808 15:59:17.456380 10942 leader_election.cc:302] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8dc897cf5bc3427692d13c9a6db9f988; no voters:
I20260808 15:59:17.456679 10942 leader_election.cc:288] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 15:59:17.456773 10947 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 15:59:17.457008 10947 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 2 LEADER]: Becoming Leader. State: Replica: 8dc897cf5bc3427692d13c9a6db9f988, State: Running, Role: LEADER
I20260808 15:59:17.457321 10947 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } }
I20260808 15:59:17.457939 10942 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:59:17.458338 10947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8dc897cf5bc3427692d13c9a6db9f988. Latest consensus state: current_term: 2 leader_uuid: "8dc897cf5bc3427692d13c9a6db9f988" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } } }
I20260808 15:59:17.458464 10947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:17.458869 10951 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:59:17.458830 10948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8dc897cf5bc3427692d13c9a6db9f988" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } } }
I20260808 15:59:17.459043 10948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:17.463570 10951 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:59:17.464263 10951 catalog_manager.cc:1259] Loaded cluster ID: 71ad78f8dc4741919817280808da657d
I20260808 15:59:17.464331 10951 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:59:17.465833 10951 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 15:59:17.470176 10951 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 15:59:17.475520 10951 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:59:17.476323 10951 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988: Loaded TSK: 0
I20260808 15:59:17.477506 10951 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 15:59:17.534340 10944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:17.534569 10944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:17.534624 10944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:17.538475 10944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:17.538528 10944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:17.538601 10944 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:59:17.543582 10944 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:34697
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=37517
--tserver_master_addrs=127.19.93.62:36847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:17.544549 10944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:17.545483 10944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:17.555392 10990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:17.555472 10992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:17.555370 10989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:17.555965 10944 server_base.cc:1034] running on GCE node
I20260808 15:59:17.556365 10944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:17.556926 10944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:17.558084 10944 hybrid_clock.cc:648] HybridClock initialized: now 1786204757558062 us; error 43 us; skew 500 ppm
Aug 08 15:59:17 dist-test-slave-lgr5 krb5kdc[9984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204757, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:17.561062 10944 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:59:17.562104 10944 webserver.cc:460] Webserver started at http://127.19.93.1:37517/ using document root <none> and password file <none>
I20260808 15:59:17.562762 10944 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:17.562887 10944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:17.567669 10944 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:59:17.570329 11003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:17.571712 10944 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 15:59:17.571851 10944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "3cba87db91c74ef3b05a725a3d686043"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "e54e2950dba3d0ba8ca1ec81e6554916"
server_key_iv: "42aa62da435a51f9ff375650433f7982"
server_key_version: "encryptionkey@0"
I20260808 15:59:17.572589 10944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:17.590553 10944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:17.594039 10944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:17.594233 10944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:17.594907 10944 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:17.596246 11015 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 15:59:17.600394 10944 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 15:59:17.600473 10944 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.001s
I20260808 15:59:17.600540 10944 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 15:59:17.602737 10944 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 15:59:17.602802 10944 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 15:59:17.603075 11015 tablet_bootstrap.cc:492] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: Bootstrap starting.
I20260808 15:59:17.613587 10944 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:34697
I20260808 15:59:17.613890 11185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:34697 every 8 connection(s)
I20260808 15:59:17.614769 10944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:59:17.620071 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 10944
I20260808 15:59:17.620615 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:36767
--local_ip_for_outbound_sockets=127.19.93.2
--tserver_master_addrs=127.19.93.62:36847
--webserver_port=40569
--webserver_interface=127.19.93.2
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:59:17.622305 11015 log.cc:824] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: Log is configured to *not* fsync() on all Append() calls
Aug 08 15:59:17 dist-test-slave-lgr5 krb5kdc[9984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204757, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:17.630159 11015 tablet_bootstrap.cc:492] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:59:17.630565 11015 tablet_bootstrap.cc:492] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: Bootstrap complete.
I20260808 15:59:17.631625 11191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.617073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:35229)
0808 15:59:17.617938 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:17.617991 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:17.619018 (+ 1027us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:17.620162 (+ 1144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:17.620171 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:17.620638 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:17.621168 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:17.621184 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.622491 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.622495 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:17.623363 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:17.623374 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.624419 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.624424 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:17.624617 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.625232 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:17.625252 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:17.626931 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:17.628951 (+ 2020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:17.628956 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:17.628969 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:17.629222 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:17.629560 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:17.629563 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:17.629565 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:17.629696 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:17.630256 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:17.630262 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:17.630520 (+ 258us) client_negotiation.cc:769] Sending connection context
0808 15:59:17.630698 (+ 178us) client_negotiation.cc:240] Negotiation successful
0808 15:59:17.630942 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":144,"threads_started":1}
I20260808 15:59:17.631924 11015 ts_tablet_manager.cc:1397] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: Time spent bootstrapping tablet: real 0.029s user 0.017s sys 0.008s
I20260808 15:59:17.632985 11190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.617082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:35229 (local address 127.19.93.62:36847)
0808 15:59:17.617626 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:17.617645 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:17.618119 (+ 474us) server_negotiation.cc:407] Connection header received
0808 15:59:17.619431 (+ 1312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:17.619442 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:17.619713 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:17.620041 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:17.621350 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.622326 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.623494 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.624239 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.624414 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.627153 (+ 2739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:17.627158 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:17.627169 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:17.627197 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:17.628833 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:17.629331 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:17.629336 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:17.629340 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:17.629458 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:17.629788 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:17.629791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:17.629792 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:17.630142 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:17.630340 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:17.632042 (+ 1702us) server_negotiation.cc:299] Negotiation successful
0808 15:59:17.632367 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":134,"threads_started":1}
I20260808 15:59:17.634840 11187 heartbeater.cc:347] Connected to a master server at 127.19.93.62:36847
I20260808 15:59:17.635072 11187 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:17.634872 11015 raft_consensus.cc:348] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } } peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } }
I20260808 15:59:17.635442 11015 raft_consensus.cc:729] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cba87db91c74ef3b05a725a3d686043, State: Initialized, Role: FOLLOWER
I20260808 15:59:17.635565 11187 heartbeater.cc:511] Master 127.19.93.62:36847 requested a full tablet report, sending...
I20260808 15:59:17.635967 11015 consensus_queue.cc:260] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } } peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } }
I20260808 15:59:17.636997 11015 ts_tablet_manager.cc:1428] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: Time spent starting tablet: real 0.005s user 0.005s sys 0.003s
I20260808 15:59:17.638280 10882 ts_manager.cc:194] Registered new tserver with Master: 3cba87db91c74ef3b05a725a3d686043 (127.19.93.1:34697)
I20260808 15:59:17.641764 10882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:35229
I20260808 15:59:17.644470 11187 heartbeater.cc:503] Master 127.19.93.62:36847 was elected leader, sending a full tablet report...
Aug 08 15:59:17 dist-test-slave-lgr5 krb5kdc[9984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204757, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for kudu/127.19.93.1@KRBTEST.COM
I20260808 15:59:17.650381 11198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.641023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51006 (local address 127.19.93.1:34697)
0808 15:59:17.641688 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:17.641701 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:17.641724 (+ 23us) server_negotiation.cc:407] Connection header received
0808 15:59:17.641792 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:17.641796 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:17.642000 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:17.642129 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:17.642796 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.643521 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.644386 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.644754 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.644860 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.647214 (+ 2354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:17.647222 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:17.647231 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:17.647252 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:17.648692 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:17.649190 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:17.649195 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:17.649196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:17.649270 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:17.649519 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:17.649521 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:17.649522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:17.649735 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:17.649828 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:17.650147 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 15:59:17.650267 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":104,"threads_started":1}
I20260808 15:59:17.650424 11197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.640964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:34697 (local address 127.0.0.1:51006)
0808 15:59:17.641360 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:17.641404 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:17.641515 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:17.642155 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:17.642161 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:17.642569 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:17.642698 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:17.642706 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.643628 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.643631 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:17.644275 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:17.644285 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.644867 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.644871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:17.644997 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.645536 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:17.645550 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:17.647085 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:17.648796 (+ 1711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:17.648805 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:17.648810 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:17.649094 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:17.649348 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:17.649351 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:17.649353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:17.649446 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:17.649829 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:17.649834 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:17.649959 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 15:59:17.650095 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 15:59:17.650266 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":111,"threads_started":1}
I20260808 15:59:17.651351 11082 tablet_service.cc:1514] Processing DeleteTablet for tablet c41d7b0a40e247fbbd788a4c5fd051c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:59:17 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:51006
I20260808 15:59:17.652238 11201 tablet_replica.cc:330] stopping tablet replica
I20260808 15:59:17.652486 11201 raft_consensus.cc:2229] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:59:17.652690 11201 raft_consensus.cc:2258] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:59:17.653549 11201 ts_tablet_manager.cc:1905] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:59:17.656852 11201 ts_tablet_manager.cc:1918] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:59:17.656937 11201 log.cc:1196] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal/wals/c41d7b0a40e247fbbd788a4c5fd051c0
I20260808 15:59:17.657177 11201 ts_tablet_manager.cc:1939] T c41d7b0a40e247fbbd788a4c5fd051c0 P 3cba87db91c74ef3b05a725a3d686043: Deleting consensus metadata
I20260808 15:59:17.658742 10853 catalog_manager.cc:4841] TS 3cba87db91c74ef3b05a725a3d686043 (127.19.93.1:34697): tablet c41d7b0a40e247fbbd788a4c5fd051c0 (table test-table [id=706eb6e4889f4b6c9154fd3f142596ff]) successfully deleted
W20260808 15:59:17.736937 11192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:17.737160 11192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:17.737215 11192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:17.741086 11192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:17.741137 11192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:17.741214 11192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:59:17.746057 11192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:36767
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=40569
--tserver_master_addrs=127.19.93.62:36847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:17.746953 11192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:17.747861 11192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:17.756944 11212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:17.756942 11206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:17.756945 11208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:17.757125 11192 server_base.cc:1034] running on GCE node
I20260808 15:59:17.757565 11192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:17.758186 11192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:17.759330 11192 hybrid_clock.cc:648] HybridClock initialized: now 1786204757759317 us; error 23 us; skew 500 ppm
Aug 08 15:59:17 dist-test-slave-lgr5 krb5kdc[9984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204757, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:17.761875 11192 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:59:17.762676 11192 webserver.cc:460] Webserver started at http://127.19.93.2:40569/ using document root <none> and password file <none>
I20260808 15:59:17.763190 11192 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:17.763263 11192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:17.766798 11192 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:17.768646 11221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:17.769728 11192 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:17.769831 11192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "6269efc962fe419ca4c25523595bb1bc"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "c9cf02b81714ff4d72a0f67792e64aee"
server_key_iv: "b05dc6454cc00d4cde96458e1f62daff"
server_key_version: "encryptionkey@0"
I20260808 15:59:17.770354 11192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:17.791141 11192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:17.793874 11192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:17.794041 11192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:17.794580 11192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:17.795367 11192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:17.795413 11192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:17.795464 11192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:17.795492 11192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:17.803761 11192 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:36767
I20260808 15:59:17.803789 11396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:36767 every 8 connection(s)
I20260808 15:59:17.804698 11192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:59:17.810871 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 11192
I20260808 15:59:17.811327 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:38607
--local_ip_for_outbound_sockets=127.19.93.3
--tserver_master_addrs=127.19.93.62:36847
--webserver_port=46203
--webserver_interface=127.19.93.3
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:59:17 dist-test-slave-lgr5 krb5kdc[9984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204757, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:17.817958 11190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.806316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:33007 (local address 127.19.93.62:36847)
0808 15:59:17.806448 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:17.806452 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:17.807215 (+ 763us) server_negotiation.cc:407] Connection header received
0808 15:59:17.808526 (+ 1311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:17.808529 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:17.808590 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:17.808666 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:17.809753 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.810279 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.811750 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.811987 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.812068 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.814572 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:17.814575 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:17.814578 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:17.814607 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:17.816027 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:17.816530 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:17.816535 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:17.816536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:17.816628 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:17.816910 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:17.816913 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:17.816915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:17.817138 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:17.817242 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:17.817657 (+ 415us) server_negotiation.cc:299] Negotiation successful
0808 15:59:17.817792 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:59:17.818607 11400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.806654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:33007)
0808 15:59:17.807072 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:17.807112 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:17.808326 (+ 1214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:17.808838 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:17.808844 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:17.809170 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:17.809610 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:17.809624 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.810400 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.810402 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:17.811611 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:17.811624 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:17.812147 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:17.812152 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:17.812324 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:17.812845 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:17.812865 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:17.814407 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:17.816159 (+ 1752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:17.816165 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:17.816178 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:17.816435 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:17.816710 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:17.816712 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:17.816713 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:17.816828 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:17.817225 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:17.817229 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:17.817433 (+ 204us) client_negotiation.cc:769] Sending connection context
0808 15:59:17.817587 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 15:59:17.817815 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":107,"threads_started":1}
I20260808 15:59:17.819721 11398 heartbeater.cc:347] Connected to a master server at 127.19.93.62:36847
I20260808 15:59:17.819936 11398 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:17.820436 11398 heartbeater.cc:511] Master 127.19.93.62:36847 requested a full tablet report, sending...
I20260808 15:59:17.821481 10882 ts_manager.cc:194] Registered new tserver with Master: 6269efc962fe419ca4c25523595bb1bc (127.19.93.2:36767)
I20260808 15:59:17.822026 10882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:33007
W20260808 15:59:17.921203 11401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:17.921420 11401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:17.921460 11401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:17.925329 11401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:17.925379 11401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:17.925448 11401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:59:17.930382 11401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:38607
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=46203
--tserver_master_addrs=127.19.93.62:36847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:17.931288 11401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:17.932226 11401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:17.941256 11412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:17.941287 11410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:17.941252 11409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:17.941457 11401 server_base.cc:1034] running on GCE node
I20260808 15:59:17.942020 11401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:17.942613 11401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:17.943769 11401 hybrid_clock.cc:648] HybridClock initialized: now 1786204757943758 us; error 27 us; skew 500 ppm
Aug 08 15:59:17 dist-test-slave-lgr5 krb5kdc[9984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204757, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:17.946293 11401 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:59:17.947142 11401 webserver.cc:460] Webserver started at http://127.19.93.3:46203/ using document root <none> and password file <none>
I20260808 15:59:17.947654 11401 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:17.947742 11401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:17.951303 11401 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:17.953229 11424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:17.954385 11401 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:59:17.954481 11401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "4cd652a1e2634afc99ea40b528b55b06"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "06c8b2a4e98457c6d5f7f330c28113b9"
server_key_iv: "0d294482815b4c2a643454c3aff5b54d"
server_key_version: "encryptionkey@0"
I20260808 15:59:17.954967 11401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:17.984625 11401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:17.987385 11401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:17.987556 11401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:17.988164 11401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:17.988976 11401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:17.989019 11401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:17.989084 11401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:17.989113 11401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:17.997411 11401 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:38607
I20260808 15:59:17.997439 11603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:38607 every 8 connection(s)
I20260808 15:59:17.998351 11401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
Aug 08 15:59:18 dist-test-slave-lgr5 krb5kdc[9984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204757, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:18.008651 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 11401
I20260808 15:59:18.011282 11190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:17.999992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:39819 (local address 127.19.93.62:36847)
0808 15:59:18.000150 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:18.000153 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:18.000972 (+ 819us) server_negotiation.cc:407] Connection header received
0808 15:59:18.002299 (+ 1327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:18.002303 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:18.002364 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:18.002435 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:18.003597 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.004152 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.005274 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.005493 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.005595 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:18.007837 (+ 2242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:18.007841 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:18.007843 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:18.007868 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:18.009374 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:18.009841 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:18.009845 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:18.009847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:18.009937 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:18.010271 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:18.010274 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:18.010276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:18.010503 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:18.010602 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:18.011067 (+ 465us) server_negotiation.cc:299] Negotiation successful
0808 15:59:18.011167 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 15:59:18.012183 11606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.000367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:39819)
0808 15:59:18.000825 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:18.000867 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:18.002088 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:18.002626 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:18.002633 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:18.002970 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:18.003438 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:18.003453 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.004278 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.004281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:18.005146 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:18.005155 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.005634 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.005638 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:18.005804 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:18.006297 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:18.006313 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:18.007669 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:18.009493 (+ 1824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:18.009499 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:18.009512 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:18.009766 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:18.010020 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:18.010023 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:18.010025 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:18.010180 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:18.010590 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:18.010595 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:18.010823 (+ 228us) client_negotiation.cc:769] Sending connection context
0808 15:59:18.011019 (+ 196us) client_negotiation.cc:240] Negotiation successful
0808 15:59:18.011342 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":121,"threads_started":1}
I20260808 15:59:18.013247 11604 heartbeater.cc:347] Connected to a master server at 127.19.93.62:36847
I20260808 15:59:18.013511 11604 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:18.014076 11604 heartbeater.cc:511] Master 127.19.93.62:36847 requested a full tablet report, sending...
I20260808 15:59:18.015199 10882 ts_manager.cc:194] Registered new tserver with Master: 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3:38607)
I20260808 15:59:18.015792 10882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:39819
I20260808 15:59:18.017270 11609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.009356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33684 (local address 127.19.93.62:36847)
0808 15:59:18.009601 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:18.009604 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:18.009745 (+ 141us) server_negotiation.cc:407] Connection header received
0808 15:59:18.009889 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:18.009891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:18.009933 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:18.010005 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:18.010813 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.011529 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.012476 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.012796 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.012884 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:18.014303 (+ 1419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:18.014306 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:18.014308 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:18.014330 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:18.015617 (+ 1287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:18.016183 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:18.016187 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:18.016188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:18.016276 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:18.016559 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:18.016561 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:18.016562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:18.016713 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:18.016857 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:18.017062 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 15:59:18.017154 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":75,"threads_started":1}
I20260808 15:59:18.019227 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:59:18.022740 11609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.019836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33690 (local address 127.19.93.62:36847)
0808 15:59:18.019944 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:18.019947 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:18.020040 (+ 93us) server_negotiation.cc:407] Connection header received
0808 15:59:18.020199 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:18.020201 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:18.020283 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:18.020354 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:59:18.020513 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.020963 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.021699 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.021905 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.021975 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:18.022185 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:59:18.022509 (+ 324us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:59:18.022587 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:18.022614 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 15:59:18.022657 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 15:59:18.023273 10882 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:33690:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:59:18.027127 10882 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:59:18.034651 11082 tablet_service.cc:1467] Processing CreateTablet for tablet 6be9303085f141188282bd5275991d86 (DEFAULT_TABLE table=test-table [id=29badd89d73c43fca3be85498c8b8936]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:59:18.035318 11082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6be9303085f141188282bd5275991d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:18.037928 11015 tablet_bootstrap.cc:492] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043: Bootstrap starting.
I20260808 15:59:18.038765 11197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.033570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:36767 (local address 127.0.0.1:59942)
0808 15:59:18.033693 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:18.033706 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:18.033768 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:18.034737 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:18.034739 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:18.034750 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:18.034823 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:18.034829 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.036118 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.036122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:18.037284 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:18.037296 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.038367 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.038371 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:18.038470 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:18.038517 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 15:59:18.038571 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 15:59:18.038643 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 15:59:18.038795 11015 tablet_bootstrap.cc:654] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:18.039403 11616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.033941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59942 (local address 127.19.93.2:36767)
0808 15:59:18.034290 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:18.034303 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:18.034326 (+ 23us) server_negotiation.cc:407] Connection header received
0808 15:59:18.034397 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:18.034403 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:18.034604 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:18.034767 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:18.034937 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.035972 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.037422 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.038228 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.038966 (+ 738us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:18.039127 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:18.039180 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 15:59:18.039268 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":135,"threads_started":1}
I20260808 15:59:18.040400 11015 tablet_bootstrap.cc:492] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043: No bootstrap required, opened a new log
I20260808 15:59:18.040491 11015 ts_tablet_manager.cc:1397] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 15:59:18.040608 11615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.033840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:38607 (local address 127.0.0.1:58836)
0808 15:59:18.034349 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:18.034360 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:18.034429 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:18.036725 (+ 2296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:18.036728 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:18.036749 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:18.036833 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:18.036840 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.038111 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.038115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:18.039136 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:18.039147 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.040238 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.040241 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:18.040331 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:18.040354 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:59:18.040404 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 15:59:18.040469 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":126,"threads_started":1}
I20260808 15:59:18.040925 11015 raft_consensus.cc:348] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } }
I20260808 15:59:18.041049 11015 raft_consensus.cc:374] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:18.041090 11015 raft_consensus.cc:729] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cba87db91c74ef3b05a725a3d686043, State: Initialized, Role: FOLLOWER
I20260808 15:59:18.041211 11617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.033986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58836 (local address 127.19.93.3:38607)
0808 15:59:18.036286 (+ 2300us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:18.036298 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:18.036319 (+ 21us) server_negotiation.cc:407] Connection header received
0808 15:59:18.036386 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:18.036391 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:18.036569 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:18.036719 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:18.036943 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.037827 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.039249 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.040070 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.040774 (+ 704us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:18.040909 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:18.040962 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 15:59:18.041077 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2202,"thread_start_us":147,"threads_started":1}
I20260808 15:59:18.041213 11015 consensus_queue.cc:260] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } }
I20260808 15:59:18.042119 11310 tablet_service.cc:1467] Processing CreateTablet for tablet 6be9303085f141188282bd5275991d86 (DEFAULT_TABLE table=test-table [id=29badd89d73c43fca3be85498c8b8936]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:59:18.043082 11310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6be9303085f141188282bd5275991d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:18.043426 11015 ts_tablet_manager.cc:1428] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260808 15:59:18.043745 11496 tablet_service.cc:1467] Processing CreateTablet for tablet 6be9303085f141188282bd5275991d86 (DEFAULT_TABLE table=test-table [id=29badd89d73c43fca3be85498c8b8936]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:59:18.044720 11496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6be9303085f141188282bd5275991d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:18.049729 11619 tablet_bootstrap.cc:492] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc: Bootstrap starting.
I20260808 15:59:18.050743 11620 tablet_bootstrap.cc:492] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06: Bootstrap starting.
I20260808 15:59:18.052156 11619 tablet_bootstrap.cc:654] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:18.052942 11620 tablet_bootstrap.cc:654] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:18.052933 11619 log.cc:824] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:18.053561 11620 log.cc:824] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:18.054581 11619 tablet_bootstrap.cc:492] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc: No bootstrap required, opened a new log
I20260808 15:59:18.054749 11619 ts_tablet_manager.cc:1397] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260808 15:59:18.055141 11620 tablet_bootstrap.cc:492] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06: No bootstrap required, opened a new log
I20260808 15:59:18.055300 11620 ts_tablet_manager.cc:1397] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 15:59:18.057557 11619 raft_consensus.cc:348] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } }
I20260808 15:59:18.057819 11619 raft_consensus.cc:374] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:18.057883 11619 raft_consensus.cc:729] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6269efc962fe419ca4c25523595bb1bc, State: Initialized, Role: FOLLOWER
I20260808 15:59:18.058079 11620 raft_consensus.cc:348] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } }
I20260808 15:59:18.058329 11619 consensus_queue.cc:260] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } }
I20260808 15:59:18.058471 11620 raft_consensus.cc:374] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:18.058534 11620 raft_consensus.cc:729] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cd652a1e2634afc99ea40b528b55b06, State: Initialized, Role: FOLLOWER
I20260808 15:59:18.058991 11398 heartbeater.cc:503] Master 127.19.93.62:36847 was elected leader, sending a full tablet report...
I20260808 15:59:18.058965 11620 consensus_queue.cc:260] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } }
I20260808 15:59:18.059293 11619 ts_tablet_manager.cc:1428] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc: Time spent starting tablet: real 0.004s user 0.004s sys 0.001s
I20260808 15:59:18.059909 11620 ts_tablet_manager.cc:1428] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20260808 15:59:18.060007 11604 heartbeater.cc:503] Master 127.19.93.62:36847 was elected leader, sending a full tablet report...
W20260808 15:59:18.116248 11189 tablet.cc:2369] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:59:18.143379 11627 raft_consensus.cc:482] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:59:18.143573 11627 raft_consensus.cc:504] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } }
I20260808 15:59:18.144692 11627 leader_election.cc:288] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6269efc962fe419ca4c25523595bb1bc (127.19.93.2:36767), 3cba87db91c74ef3b05a725a3d686043 (127.19.93.1:34697)
I20260808 15:59:18.148140 11606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.144925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:36767 (local address 127.19.93.3:46149)
0808 15:59:18.145047 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:18.145065 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:18.145163 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:18.145463 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:18.145466 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:18.145486 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:18.145584 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:18.145589 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.146293 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.146296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:18.147099 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:18.147109 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.147722 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.147726 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:18.147826 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:18.147845 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 15:59:18.147910 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 15:59:18.147981 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 15:59:18.148140 11616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.145022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:46149 (local address 127.19.93.2:36767)
0808 15:59:18.145183 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:18.145188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:18.145206 (+ 18us) server_negotiation.cc:407] Connection header received
0808 15:59:18.145265 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:18.145268 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:18.145319 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:18.145396 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:18.145692 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.146192 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.147227 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.147617 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.147706 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:18.147769 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:18.147943 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 15:59:18.148015 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 15:59:18.148726 11628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.145163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:34697 (local address 127.19.93.3:57049)
0808 15:59:18.145503 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:18.145514 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:18.145604 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:18.145841 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:18.145844 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:18.145859 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:18.145998 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:18.146004 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.146750 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.146753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:18.147553 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:18.147562 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.148379 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.148383 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:18.148480 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:18.148503 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:59:18.148573 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 15:59:18.148626 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":113,"threads_started":1}
I20260808 15:59:18.148808 11198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.145274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:57049 (local address 127.19.93.1:34697)
0808 15:59:18.145395 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:18.145399 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:18.145584 (+ 185us) server_negotiation.cc:407] Connection header received
0808 15:59:18.145686 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:18.145689 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:18.145744 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:18.145822 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:18.146114 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.146647 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.147668 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.148171 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.148273 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:18.148425 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:18.148609 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 15:59:18.148691 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 15:59:18.148842 11344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6be9303085f141188282bd5275991d86" candidate_uuid: "4cd652a1e2634afc99ea40b528b55b06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6269efc962fe419ca4c25523595bb1bc" is_pre_election: true
I20260808 15:59:18.149159 11344 raft_consensus.cc:2454] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cd652a1e2634afc99ea40b528b55b06 in term 0.
I20260808 15:59:18.149299 11114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6be9303085f141188282bd5275991d86" candidate_uuid: "4cd652a1e2634afc99ea40b528b55b06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cba87db91c74ef3b05a725a3d686043" is_pre_election: true
I20260808 15:59:18.149582 11114 raft_consensus.cc:2454] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cd652a1e2634afc99ea40b528b55b06 in term 0.
I20260808 15:59:18.149614 11427 leader_election.cc:302] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cd652a1e2634afc99ea40b528b55b06, 6269efc962fe419ca4c25523595bb1bc; no voters:
I20260808 15:59:18.149873 11627 raft_consensus.cc:2781] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:59:18.149962 11627 raft_consensus.cc:482] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:59:18.150012 11627 raft_consensus.cc:3037] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:18.151010 11627 raft_consensus.cc:504] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } }
I20260808 15:59:18.151310 11627 leader_election.cc:288] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [CANDIDATE]: Term 1 election: Requested vote from peers 6269efc962fe419ca4c25523595bb1bc (127.19.93.2:36767), 3cba87db91c74ef3b05a725a3d686043 (127.19.93.1:34697)
I20260808 15:59:18.151670 11344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6be9303085f141188282bd5275991d86" candidate_uuid: "4cd652a1e2634afc99ea40b528b55b06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6269efc962fe419ca4c25523595bb1bc"
I20260808 15:59:18.151672 11114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6be9303085f141188282bd5275991d86" candidate_uuid: "4cd652a1e2634afc99ea40b528b55b06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cba87db91c74ef3b05a725a3d686043"
I20260808 15:59:18.151789 11114 raft_consensus.cc:3037] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:18.151790 11344 raft_consensus.cc:3037] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:18.152984 11344 raft_consensus.cc:2454] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd652a1e2634afc99ea40b528b55b06 in term 1.
I20260808 15:59:18.152984 11114 raft_consensus.cc:2454] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd652a1e2634afc99ea40b528b55b06 in term 1.
I20260808 15:59:18.153249 11427 leader_election.cc:302] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cba87db91c74ef3b05a725a3d686043, 4cd652a1e2634afc99ea40b528b55b06; no voters:
I20260808 15:59:18.153510 11627 raft_consensus.cc:2781] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:59:18.153726 11627 raft_consensus.cc:686] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [term 1 LEADER]: Becoming Leader. State: Replica: 4cd652a1e2634afc99ea40b528b55b06, State: Running, Role: LEADER
I20260808 15:59:18.154057 11627 consensus_queue.cc:237] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } }
I20260808 15:59:18.157156 10882 catalog_manager.cc:5495] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3). New cstate: current_term: 1 leader_uuid: "4cd652a1e2634afc99ea40b528b55b06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } health_report { overall_health: UNKNOWN } } }
I20260808 15:59:18.191380 11617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.188037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58844 (local address 127.19.93.3:38607)
0808 15:59:18.188183 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:18.188188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:18.188203 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:59:18.188368 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:18.188371 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:18.188424 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:18.188511 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:59:18.188744 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.189226 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.190030 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:18.190238 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:18.190325 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:18.190622 (+ 297us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:59:18.191009 (+ 387us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:59:18.191116 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:18.191199 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 15:59:18.191255 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 15:59:18.196904 11344 raft_consensus.cc:1261] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc [term 1 FOLLOWER]: Refusing update from remote peer 4cd652a1e2634afc99ea40b528b55b06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:59:18.196902 11114 raft_consensus.cc:1261] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Refusing update from remote peer 4cd652a1e2634afc99ea40b528b55b06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:59:18.197552 11630 consensus_queue.cc:1035] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:59:18.197737 11627 consensus_queue.cc:1035] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:59:18.203373 11635 mvcc.cc:205] Tried to move back new op lower bound from 7316294689567543296 to 7316294689401671680. Current Snapshot: MvccSnapshot[applied={T|T < 7316294689567543296}]
I20260808 15:59:18.203657 11636 mvcc.cc:205] Tried to move back new op lower bound from 7316294689567543296 to 7316294689401671680. Current Snapshot: MvccSnapshot[applied={T|T < 7316294689567543296}]
I20260808 15:59:18.206288 11638 mvcc.cc:205] Tried to move back new op lower bound from 7316294689567543296 to 7316294689401671680. Current Snapshot: MvccSnapshot[applied={T|T < 7316294689567543296}]
I20260808 15:59:18.211380 10881 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:33690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:59:18.211511 10881 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:33690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:59:18.213603 10881 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988: Sending DeleteTablet for 3 replicas of tablet 6be9303085f141188282bd5275991d86
I20260808 15:59:18.214290 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 10944
I20260808 15:59:18.214246 11496 tablet_service.cc:1514] Processing DeleteTablet for tablet 6be9303085f141188282bd5275991d86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:59:18 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:58836
I20260808 15:59:18.214407 11310 tablet_service.cc:1514] Processing DeleteTablet for tablet 6be9303085f141188282bd5275991d86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:59:18 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:59942
I20260808 15:59:18.220382 11649 tablet_replica.cc:330] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06: stopping tablet replica
I20260808 15:59:18.220773 11649 raft_consensus.cc:2229] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:59:18.221205 11649 raft_consensus.cc:2258] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:59:18.223321 11649 ts_tablet_manager.cc:1905] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:59:18.226145 11649 ts_tablet_manager.cc:1918] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:59:18.226250 11649 log.cc:1196] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/6be9303085f141188282bd5275991d86
I20260808 15:59:18.226526 11649 ts_tablet_manager.cc:1939] T 6be9303085f141188282bd5275991d86 P 4cd652a1e2634afc99ea40b528b55b06: Deleting consensus metadata
I20260808 15:59:18.227573 10859 catalog_manager.cc:4841] TS 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3:38607): tablet 6be9303085f141188282bd5275991d86 (table test-table [id=29badd89d73c43fca3be85498c8b8936]) successfully deleted
I20260808 15:59:18.228860 11650 tablet_replica.cc:330] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc: stopping tablet replica
I20260808 15:59:18.229204 11650 raft_consensus.cc:2229] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:59:18.229532 11650 raft_consensus.cc:2258] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:59:18.230934 11650 ts_tablet_manager.cc:1905] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:59:18.233454 11650 ts_tablet_manager.cc:1918] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:59:18.233560 11650 log.cc:1196] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/6be9303085f141188282bd5275991d86
I20260808 15:59:18.233872 11650 ts_tablet_manager.cc:1939] T 6be9303085f141188282bd5275991d86 P 6269efc962fe419ca4c25523595bb1bc: Deleting consensus metadata
W20260808 15:59:18.234072 10853 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:34697 (error 108)
I20260808 15:59:18.235092 10853 catalog_manager.cc:4841] TS 6269efc962fe419ca4c25523595bb1bc (127.19.93.2:36767): tablet 6be9303085f141188282bd5275991d86 (table test-table [id=29badd89d73c43fca3be85498c8b8936]) successfully deleted
W20260808 15:59:18.235430 11615 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:59:18.234932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:34697 (local address 127.0.0.1:51014)
0808 15:59:18.235046 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:18.235072 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:18.235157 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:18.235332 (+ 175us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:34697: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 15:59:18.235647 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 11192
W20260808 15:59:18.241120 10853 catalog_manager.cc:4584] TS 3cba87db91c74ef3b05a725a3d686043 (127.19.93.1:34697): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6be9303085f141188282bd5275991d86: Network error: Client connection negotiation failed: client connection to 127.19.93.1:34697: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 15:59:18.245728 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 11401
I20260808 15:59:18.260439 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 10825
I20260808 15:59:18.270920 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:36847
--webserver_interface=127.19.93.62
--webserver_port=37727
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:36847
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:18.376854 11654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:18.377095 11654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:18.377149 11654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:18.381035 11654 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:59:18.381086 11654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:18.381111 11654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:18.381134 11654 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:59:18.381163 11654 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:59:18.386185 11654 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:36847
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:36847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=37727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:18.387133 11654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:18.388051 11654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:18.395802 11665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:18.395852 11654 server_base.cc:1034] running on GCE node
W20260808 15:59:18.395792 11660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:18.395771 11659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:18.396865 11654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:18.397817 11654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:18.398965 11654 hybrid_clock.cc:648] HybridClock initialized: now 1786204758398948 us; error 29 us; skew 500 ppm
Aug 08 15:59:18 dist-test-slave-lgr5 krb5kdc[9984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204758, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:18.401479 11654 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:59:18.402279 11654 webserver.cc:460] Webserver started at http://127.19.93.62:37727/ using document root <none> and password file <none>
I20260808 15:59:18.402745 11654 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:18.402798 11654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:18.406251 11654 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:59:18.408218 11679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:18.409317 11654 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:18.409430 11654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "8dc897cf5bc3427692d13c9a6db9f988"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "1d5bed7d181e9764005af4280f2c34ad"
server_key_iv: "f3e4dd07814602c55c5541f443f57e98"
server_key_version: "encryptionkey@0"
I20260808 15:59:18.409932 11654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:18.425961 11654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:18.428401 11654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:18.428557 11654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:18.435050 11654 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:36847
I20260808 15:59:18.435315 11770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:36847 every 8 connection(s)
I20260808 15:59:18.436043 11654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:59:18.436304 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 11654
I20260808 15:59:18.436745 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:34697
--local_ip_for_outbound_sockets=127.19.93.1
--tserver_master_addrs=127.19.93.62:36847
--webserver_port=37517
--webserver_interface=127.19.93.1
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:59:18.440264 11771 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:59:18.442358 11771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988: Bootstrap starting.
I20260808 15:59:18.465294 11771 log.cc:824] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:18.477025 11771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:59:18.477349 11771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988: Bootstrap complete.
I20260808 15:59:18.481197 11771 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } }
I20260808 15:59:18.481580 11771 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc897cf5bc3427692d13c9a6db9f988, State: Initialized, Role: FOLLOWER
I20260808 15:59:18.482057 11771 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } }
I20260808 15:59:18.482184 11771 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:59:18.482252 11771 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:59:18.482348 11771 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 2 FOLLOWER]: Advancing to term 3
I20260808 15:59:18.484133 11771 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } }
I20260808 15:59:18.484444 11771 leader_election.cc:302] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8dc897cf5bc3427692d13c9a6db9f988; no voters:
I20260808 15:59:18.484735 11771 leader_election.cc:288] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 15:59:18.484884 11775 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 15:59:18.485147 11775 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [term 3 LEADER]: Becoming Leader. State: Replica: 8dc897cf5bc3427692d13c9a6db9f988, State: Running, Role: LEADER
I20260808 15:59:18.485469 11775 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } }
I20260808 15:59:18.485925 11771 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:59:18.486851 11776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "8dc897cf5bc3427692d13c9a6db9f988" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } } }
I20260808 15:59:18.486991 11776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:18.487224 11776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8dc897cf5bc3427692d13c9a6db9f988. Latest consensus state: current_term: 3 leader_uuid: "8dc897cf5bc3427692d13c9a6db9f988" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc897cf5bc3427692d13c9a6db9f988" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 36847 } } }
I20260808 15:59:18.487318 11776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dc897cf5bc3427692d13c9a6db9f988 [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:18.488019 11785 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:59:18.493584 11785 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:59:18.494299 11785 catalog_manager.cc:1259] Loaded cluster ID: 71ad78f8dc4741919817280808da657d
I20260808 15:59:18.494369 11785 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 15:59:18.495963 11785 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f92d02ba9ad google::LogMessage::Fail() at ??:0
@ 0x7f92d02bd88a google::LogMessage::SendToLog() at ??:0
@ 0x7f92d02ba4de google::LogMessage::Flush() at ??:0
@ 0x7f92d02bba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f92dabfdfdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f92dabfed2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f92dabfb579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f92dac3f640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f92d250c3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f92d250cc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f92d250e3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f92d24fd512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f92d3b416db start_thread at ??:0
@ 0x7f92cedb861f clone at ??:0
W20260808 15:59:18.572907 11773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:18.573143 11773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:18.573203 11773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:18.577128 11773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:18.577179 11773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:18.577253 11773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:59:18.582319 11773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:34697
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=37517
--tserver_master_addrs=127.19.93.62:36847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:18.583324 11773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:18.584345 11773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:18.593680 11820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:18.593741 11825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:18.593832 11773 server_base.cc:1034] running on GCE node
W20260808 15:59:18.593680 11821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:18.594340 11773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:18.594928 11773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:18.596112 11773 hybrid_clock.cc:648] HybridClock initialized: now 1786204758596083 us; error 42 us; skew 500 ppm
Aug 08 15:59:18 dist-test-slave-lgr5 krb5kdc[9984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204758, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:18.598862 11773 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:59:18.599695 11773 webserver.cc:460] Webserver started at http://127.19.93.1:37517/ using document root <none> and password file <none>
I20260808 15:59:18.600260 11773 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:18.600329 11773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:18.603919 11773 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:59:18.606041 11835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:18.607312 11773 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:18.607429 11773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "3cba87db91c74ef3b05a725a3d686043"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "e54e2950dba3d0ba8ca1ec81e6554916"
server_key_iv: "42aa62da435a51f9ff375650433f7982"
server_key_version: "encryptionkey@0"
I20260808 15:59:18.607963 11773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:18.627990 11773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:18.630934 11773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:18.631107 11773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:18.631669 11773 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:18.632786 11847 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 15:59:18.638175 11773 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 15:59:18.638229 11773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260808 15:59:18.638283 11773 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 15:59:18.639894 11773 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 15:59:18.639940 11773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 15:59:18.640292 11847 tablet_bootstrap.cc:492] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043: Bootstrap starting.
I20260808 15:59:18.649442 11773 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:34697
I20260808 15:59:18.649701 12011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:34697 every 8 connection(s)
I20260808 15:59:18.650405 11773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:59:18.654484 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 11773
I20260808 15:59:18.654878 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:36767
--local_ip_for_outbound_sockets=127.19.93.2
--tserver_master_addrs=127.19.93.62:36847
--webserver_port=40569
--webserver_interface=127.19.93.2
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:59:18.661900 11847 log.cc:824] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:18.670650 11847 tablet_bootstrap.cc:492] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:59:18.671054 11847 tablet_bootstrap.cc:492] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043: Bootstrap complete.
I20260808 15:59:18.672425 11847 ts_tablet_manager.cc:1397] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043: Time spent bootstrapping tablet: real 0.032s user 0.017s sys 0.015s
I20260808 15:59:18.675587 11847 raft_consensus.cc:348] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } }
I20260808 15:59:18.676162 11847 raft_consensus.cc:729] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cba87db91c74ef3b05a725a3d686043, State: Initialized, Role: FOLLOWER
I20260808 15:59:18.676682 11847 consensus_queue.cc:260] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } }
I20260808 15:59:18.677690 11847 ts_tablet_manager.cc:1428] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
W20260808 15:59:18.711503 12014 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:59:18.652227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:36117)
0808 15:59:18.652696 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:18.652748 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:18.653510 (+ 762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:18.710521 (+ 57011us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":116,"threads_started":1}
W20260808 15:59:18.711992 12012 heartbeater.cc:644] Failed to heartbeat to 127.19.93.62:36847 (0 consecutive failures): Network error: Failed to ping master at 127.19.93.62:36847: Client connection negotiation failed: client connection to 127.19.93.62:36847: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 15:59:18.712774 12014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.712499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:57025)
0808 15:59:18.712627 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:18.712705 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 15:59:18.713394 12014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.713192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:41945)
0808 15:59:18.713289 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:18.713338 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 15:59:18.713553 12012 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 15:59:18.766641 12015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:18.766856 12015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:18.766894 12015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:18.770756 12015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:18.770812 12015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:18.770887 12015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:59:18.776153 12015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:36767
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=40569
--tserver_master_addrs=127.19.93.62:36847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:18.777001 12015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:18.777880 12015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:18.786839 12025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:18.786825 12028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:18.787003 12015 server_base.cc:1034] running on GCE node
W20260808 15:59:18.787156 12026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:18.787595 12015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:18.788189 12015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:18.789362 12015 hybrid_clock.cc:648] HybridClock initialized: now 1786204758789339 us; error 29 us; skew 500 ppm
Aug 08 15:59:18 dist-test-slave-lgr5 krb5kdc[9984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204758, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:18.791989 12015 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:59:18.792752 12015 webserver.cc:460] Webserver started at http://127.19.93.2:40569/ using document root <none> and password file <none>
I20260808 15:59:18.793224 12015 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:18.793278 12015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:18.796726 12015 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:59:18.798574 12038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:18.799649 12015 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:18.799744 12015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "6269efc962fe419ca4c25523595bb1bc"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "c9cf02b81714ff4d72a0f67792e64aee"
server_key_iv: "b05dc6454cc00d4cde96458e1f62daff"
server_key_version: "encryptionkey@0"
I20260808 15:59:18.800292 12015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:18.819133 12015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:18.821651 12015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:18.821806 12015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:18.822328 12015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:18.823092 12015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:18.823137 12015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:18.823179 12015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:18.823207 12015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:18.831339 12015 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:36767
I20260808 15:59:18.831399 12216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:36767 every 8 connection(s)
I20260808 15:59:18.832275 12015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:59:18.835793 12220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.834257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:53949)
0808 15:59:18.834714 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:18.835127 (+ 413us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":122,"threads_started":1}
W20260808 15:59:18.836212 12218 heartbeater.cc:644] Failed to heartbeat to 127.19.93.62:36847 (0 consecutive failures): Network error: Failed to ping master at 127.19.93.62:36847: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
I20260808 15:59:18.836722 12220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.836534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:53769)
0808 15:59:18.836625 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:18.836669 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 15:59:18.837217 12220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:18.837043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:32795)
0808 15:59:18.837128 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:18.837167 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 15:59:18.837361 12218 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 15:59:18.841502 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 12015
I20260808 15:59:18.841882 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:38607
--local_ip_for_outbound_sockets=127.19.93.3
--tserver_master_addrs=127.19.93.62:36847
--webserver_port=46203
--webserver_interface=127.19.93.3
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:38465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:18.950398 12221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:18.950629 12221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:18.950668 12221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:18.954510 12221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:18.954556 12221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:18.954609 12221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:59:18.959507 12221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:38465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:38607
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=46203
--tserver_master_addrs=127.19.93.62:36847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:18.960399 12221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:18.961277 12221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:18.970260 12228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:18.970271 12227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:18.970268 12232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:18.970456 12221 server_base.cc:1034] running on GCE node
I20260808 15:59:18.970954 12221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:18.971570 12221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:18.972754 12221 hybrid_clock.cc:648] HybridClock initialized: now 1786204758972735 us; error 28 us; skew 500 ppm
Aug 08 15:59:18 dist-test-slave-lgr5 krb5kdc[9984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204758, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:18.975360 12221 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:59:18.976187 12221 webserver.cc:460] Webserver started at http://127.19.93.3:46203/ using document root <none> and password file <none>
I20260808 15:59:18.976670 12221 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:18.976724 12221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:18.980233 12221 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.003s
I20260808 15:59:18.982131 12244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:18.983278 12221 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:18.983381 12221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "4cd652a1e2634afc99ea40b528b55b06"
format_stamp: "Formatted at 2026-08-08 15:59:16 on dist-test-slave-lgr5"
server_key: "06c8b2a4e98457c6d5f7f330c28113b9"
server_key_iv: "0d294482815b4c2a643454c3aff5b54d"
server_key_version: "encryptionkey@0"
I20260808 15:59:18.983896 12221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:18.996258 12221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:18.998958 12221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:18.999135 12221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:18.999701 12221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:19.000628 12221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:19.000684 12221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:19.000741 12221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:19.000771 12221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:19.010551 12221 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:38607
I20260808 15:59:19.010703 12411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:38607 every 8 connection(s)
I20260808 15:59:19.011696 12221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:59:19.018050 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 12221
I20260808 15:59:19.019053 12415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:19.014279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:35807)
0808 15:59:19.014850 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:19.018063 (+ 3213us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":145,"threads_started":1}
W20260808 15:59:19.019511 12413 heartbeater.cc:644] Failed to heartbeat to 127.19.93.62:36847 (0 consecutive failures): Network error: Failed to ping master at 127.19.93.62:36847: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
I20260808 15:59:19.020117 12415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:19.019860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:49901)
0808 15:59:19.019963 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:19.020016 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 15:59:19.020704 12415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:19.020506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:43001)
0808 15:59:19.020604 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:19.020649 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 15:59:19.020895 12413 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 15:59:19.714424 12419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:19.714039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:39107)
0808 15:59:19.714268 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:19.714319 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":73,"threads_started":1}
I20260808 15:59:19.838178 12420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:19.837813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:46287)
0808 15:59:19.838032 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:19.838085 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":66,"threads_started":1}
I20260808 15:59:20.021700 12421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:20.021323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:33945)
0808 15:59:20.021553 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:20.021605 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":71,"threads_started":1}
I20260808 15:59:20.288369 12422 raft_consensus.cc:482] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:59:20.288564 12422 raft_consensus.cc:504] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } }
I20260808 15:59:20.289582 12422 leader_election.cc:288] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6269efc962fe419ca4c25523595bb1bc (127.19.93.2:36767), 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3:38607)
Aug 08 15:59:20 dist-test-slave-lgr5 krb5kdc[9984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204758, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.3@KRBTEST.COM
Aug 08 15:59:20 dist-test-slave-lgr5 krb5kdc[9984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204758, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.2@KRBTEST.COM
I20260808 15:59:20.305301 12428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:20.289781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:36767 (local address 127.19.93.1:39979)
0808 15:59:20.290430 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:20.290442 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:20.290527 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:20.292169 (+ 1642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:20.292172 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:20.292675 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:20.293433 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:20.293455 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:20.295332 (+ 1877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:20.295336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:20.296869 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:20.296883 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:20.297798 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:20.297802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:20.298082 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:20.298775 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:20.298798 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:20.301020 (+ 2222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:20.302852 (+ 1832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:20.302855 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:20.302857 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:20.303190 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:20.303578 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:20.303582 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:20.303583 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:20.303732 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:20.304576 (+ 844us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:20.304579 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:20.304714 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 15:59:20.304857 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 15:59:20.305171 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"mutex_wait_us":692,"spinlock_wait_cycles":36352,"thread_start_us":71,"threads_started":1}
I20260808 15:59:20.305459 12427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:20.289945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:39979 (local address 127.19.93.2:36767)
0808 15:59:20.290358 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:20.290377 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:20.290523 (+ 146us) server_negotiation.cc:407] Connection header received
0808 15:59:20.291276 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:20.291283 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:20.291653 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:20.291986 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:20.293613 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:20.295165 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:20.296981 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:20.297684 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:20.297853 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:20.301190 (+ 3337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:20.301194 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:20.301205 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:20.301233 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:20.302737 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:20.303322 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:20.303327 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:20.303333 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:20.303481 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:20.303838 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:20.303841 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:20.303843 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:20.304392 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:20.304515 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:20.305004 (+ 489us) server_negotiation.cc:299] Negotiation successful
0808 15:59:20.305282 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":114,"threads_started":1}
I20260808 15:59:20.305611 12425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:20.289931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:35043 (local address 127.19.93.3:38607)
0808 15:59:20.290231 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:20.290261 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:20.290310 (+ 49us) server_negotiation.cc:407] Connection header received
0808 15:59:20.291197 (+ 887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:20.291206 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:20.291653 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:20.291986 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:20.293612 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:20.295165 (+ 1553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:20.296981 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:20.297684 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:20.297853 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:20.300833 (+ 2980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:20.300839 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:20.300853 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:20.300886 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:20.302668 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:20.303293 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:20.303299 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:20.303304 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:20.303500 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:20.303852 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:20.303855 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:20.303857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:20.304380 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:20.304515 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:20.305208 (+ 693us) server_negotiation.cc:299] Negotiation successful
0808 15:59:20.305453 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":74,"threads_started":1}
I20260808 15:59:20.305286 12423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:20.289781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:38607 (local address 127.19.93.1:35043)
0808 15:59:20.290130 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:20.290144 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:20.290253 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:20.292025 (+ 1772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:20.292030 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:20.292676 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:20.293433 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:20.293455 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:20.295333 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:20.295336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:20.296869 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:20.296893 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:20.297798 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:20.297802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:20.298086 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:20.298787 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:20.298808 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:20.300620 (+ 1812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:20.302769 (+ 2149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:20.302775 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:20.302789 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:20.303162 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:20.303649 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:20.303652 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:20.303654 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:20.303745 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:20.304491 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:20.304496 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:20.304711 (+ 215us) client_negotiation.cc:769] Sending connection context
0808 15:59:20.304855 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 15:59:20.305090 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":278,"spinlock_wait_cycles":12672,"thread_start_us":95,"threads_started":1}
W20260808 15:59:20.307725 11839 leader_election.cc:341] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6269efc962fe419ca4c25523595bb1bc (127.19.93.2:36767): Not found: Tablet not found: 6be9303085f141188282bd5275991d86
W20260808 15:59:20.307859 11840 leader_election.cc:341] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3:38607): Not found: Tablet not found: 6be9303085f141188282bd5275991d86
I20260808 15:59:20.307972 11840 leader_election.cc:302] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cba87db91c74ef3b05a725a3d686043; no voters: 4cd652a1e2634afc99ea40b528b55b06, 6269efc962fe419ca4c25523595bb1bc
I20260808 15:59:20.308245 12422 raft_consensus.cc:2726] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 15:59:20.715312 12428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:20.715054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:56391)
0808 15:59:20.715173 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:20.715226 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 15:59:20.839176 12430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:20.838805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:58153)
0808 15:59:20.839034 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:20.839088 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":70,"threads_started":1}
I20260808 15:59:21.022742 12432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:21.022335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:37733)
0808 15:59:21.022602 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:21.022654 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":108,"threads_started":1}
I20260808 15:59:21.716356 12433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:21.715954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:50511)
0808 15:59:21.716208 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:21.716261 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":79,"threads_started":1}
I20260808 15:59:21.840204 12434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:21.839786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:55039)
0808 15:59:21.840018 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:21.840104 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":73,"threads_started":1}
I20260808 15:59:22.023769 12435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:22.023363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:52801)
0808 15:59:22.023623 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:22.023680 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":72,"threads_started":1}
I20260808 15:59:22.545957 12436 raft_consensus.cc:482] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:59:22.546104 12436 raft_consensus.cc:504] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } }
I20260808 15:59:22.546463 12436 leader_election.cc:288] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6269efc962fe419ca4c25523595bb1bc (127.19.93.2:36767), 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3:38607)
W20260808 15:59:22.547312 11839 leader_election.cc:341] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6269efc962fe419ca4c25523595bb1bc (127.19.93.2:36767): Not found: Tablet not found: 6be9303085f141188282bd5275991d86
W20260808 15:59:22.547431 11840 leader_election.cc:341] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3:38607): Not found: Tablet not found: 6be9303085f141188282bd5275991d86
I20260808 15:59:22.547502 11840 leader_election.cc:302] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cba87db91c74ef3b05a725a3d686043; no voters: 4cd652a1e2634afc99ea40b528b55b06, 6269efc962fe419ca4c25523595bb1bc
I20260808 15:59:22.547638 12436 raft_consensus.cc:2726] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 15:59:22.717383 12437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:22.717018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:58229)
0808 15:59:22.717236 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:22.717287 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":73,"threads_started":1}
I20260808 15:59:22.841308 12438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:22.840856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:52021)
0808 15:59:22.841163 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:22.841222 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":103,"threads_started":1}
I20260808 15:59:23.024768 12441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:23.024403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:38365)
0808 15:59:23.024631 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:23.024682 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":70,"threads_started":1}
I20260808 15:59:23.718614 12443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:23.718182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:54379)
0808 15:59:23.718455 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:23.718507 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":89,"threads_started":1}
I20260808 15:59:23.842344 12444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:23.841942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:54425)
0808 15:59:23.842203 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:23.842255 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":102,"threads_started":1}
I20260808 15:59:24.025995 12445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:24.025503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:36491)
0808 15:59:24.025828 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:24.025888 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":85,"threads_started":1}
I20260808 15:59:24.547091 12446 raft_consensus.cc:482] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:59:24.547228 12446 raft_consensus.cc:504] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } }
I20260808 15:59:24.547633 12446 leader_election.cc:288] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6269efc962fe419ca4c25523595bb1bc (127.19.93.2:36767), 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3:38607)
W20260808 15:59:24.548489 11840 leader_election.cc:341] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3:38607): Not found: Tablet not found: 6be9303085f141188282bd5275991d86
W20260808 15:59:24.548600 11839 leader_election.cc:341] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6269efc962fe419ca4c25523595bb1bc (127.19.93.2:36767): Not found: Tablet not found: 6be9303085f141188282bd5275991d86
I20260808 15:59:24.548700 11839 leader_election.cc:302] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cba87db91c74ef3b05a725a3d686043; no voters: 4cd652a1e2634afc99ea40b528b55b06, 6269efc962fe419ca4c25523595bb1bc
I20260808 15:59:24.548852 12446 raft_consensus.cc:2726] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 15:59:24.719838 12447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:24.719367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:47451)
0808 15:59:24.719667 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:24.719738 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":78,"threads_started":1}
I20260808 15:59:24.843521 12448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:24.843082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:42709)
0808 15:59:24.843371 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:24.843432 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":92,"threads_started":1}
I20260808 15:59:25.027242 12449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:25.026807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:34549)
0808 15:59:25.027087 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:25.027150 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":78,"threads_started":1}
I20260808 15:59:25.720993 12450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:25.720591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:47679)
0808 15:59:25.720843 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:25.720895 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":90,"threads_started":1}
I20260808 15:59:25.844748 12451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:25.844291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:42287)
0808 15:59:25.844610 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:25.844662 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":80,"threads_started":1}
I20260808 15:59:26.028385 12453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:26.027918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:55105)
0808 15:59:26.028244 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:26.028296 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":118,"threads_started":1}
I20260808 15:59:26.722025 12454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:26.721643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:60077)
0808 15:59:26.721876 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:26.721928 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":76,"threads_started":1}
I20260808 15:59:26.845726 12455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:26.845355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:36697)
0808 15:59:26.845585 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:26.845637 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":72,"threads_started":1}
I20260808 15:59:27.029372 12456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:27.029004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:55809)
0808 15:59:27.029234 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:27.029284 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":77,"threads_started":1}
I20260808 15:59:27.411453 12458 raft_consensus.cc:482] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:59:27.411585 12458 raft_consensus.cc:504] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } }
I20260808 15:59:27.412022 12458 leader_election.cc:288] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6269efc962fe419ca4c25523595bb1bc (127.19.93.2:36767), 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3:38607)
W20260808 15:59:27.412757 11840 leader_election.cc:341] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3:38607): Not found: Tablet not found: 6be9303085f141188282bd5275991d86
W20260808 15:59:27.412848 11839 leader_election.cc:341] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6269efc962fe419ca4c25523595bb1bc (127.19.93.2:36767): Not found: Tablet not found: 6be9303085f141188282bd5275991d86
I20260808 15:59:27.412945 11839 leader_election.cc:302] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cba87db91c74ef3b05a725a3d686043; no voters: 4cd652a1e2634afc99ea40b528b55b06, 6269efc962fe419ca4c25523595bb1bc
I20260808 15:59:27.413102 12458 raft_consensus.cc:2726] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 15:59:27.723109 12459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:27.722685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:55521)
0808 15:59:27.722947 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:27.722997 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":95,"threads_started":1}
I20260808 15:59:27.846743 12461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:27.846372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:44547)
0808 15:59:27.846601 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:27.846652 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":73,"threads_started":1}
I20260808 15:59:28.030381 12462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:28.030011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:53863)
0808 15:59:28.030243 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:28.030294 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":73,"threads_started":1}
I20260808 15:59:28.724323 12464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:28.723890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:54057)
0808 15:59:28.724172 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:28.724224 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":88,"threads_started":1}
I20260808 15:59:28.847900 12465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:28.847507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:52301)
0808 15:59:28.847754 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:28.847805 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":82,"threads_started":1}
I20260808 15:59:29.031613 12467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:29.031159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:45089)
0808 15:59:29.031434 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:29.031497 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":90,"threads_started":1}
I20260808 15:59:29.725368 12468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:29.724972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:53853)
0808 15:59:29.725214 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:29.725269 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":71,"threads_started":1}
I20260808 15:59:29.848951 12469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:29.848577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:44305)
0808 15:59:29.848810 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:29.848861 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":71,"threads_started":1}
I20260808 15:59:30.032867 12470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:30.032487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:35601)
0808 15:59:30.032717 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:30.032771 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":78,"threads_started":1}
I20260808 15:59:30.726445 12472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:30.726052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:33147)
0808 15:59:30.726273 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:30.726326 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":75,"threads_started":1}
I20260808 15:59:30.850060 12473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:30.849628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:55087)
0808 15:59:30.849911 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:30.849966 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":97,"threads_started":1}
I20260808 15:59:31.033934 12477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:31.033505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:34343)
0808 15:59:31.033773 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:31.033827 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":117,"threads_started":1}
I20260808 15:59:31.727530 12478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:31.727121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:60049)
0808 15:59:31.727377 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:31.727432 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":89,"threads_started":1}
I20260808 15:59:31.851162 12479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:31.850750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:54029)
0808 15:59:31.850997 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:31.851062 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":97,"threads_started":1}
I20260808 15:59:32.035161 12480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:32.034618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:41179)
0808 15:59:32.034973 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:32.035042 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":113,"threads_started":1}
I20260808 15:59:32.247422 12481 raft_consensus.cc:482] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:59:32.247567 12481 raft_consensus.cc:504] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6269efc962fe419ca4c25523595bb1bc" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 36767 } } peers { permanent_uuid: "4cd652a1e2634afc99ea40b528b55b06" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38607 } } peers { permanent_uuid: "3cba87db91c74ef3b05a725a3d686043" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 34697 } }
I20260808 15:59:32.248000 12481 leader_election.cc:288] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6269efc962fe419ca4c25523595bb1bc (127.19.93.2:36767), 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3:38607)
W20260808 15:59:32.248816 11840 leader_election.cc:341] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4cd652a1e2634afc99ea40b528b55b06 (127.19.93.3:38607): Not found: Tablet not found: 6be9303085f141188282bd5275991d86
W20260808 15:59:32.248935 11839 leader_election.cc:341] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6269efc962fe419ca4c25523595bb1bc (127.19.93.2:36767): Not found: Tablet not found: 6be9303085f141188282bd5275991d86
I20260808 15:59:32.249002 11839 leader_election.cc:302] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cba87db91c74ef3b05a725a3d686043; no voters: 4cd652a1e2634afc99ea40b528b55b06, 6269efc962fe419ca4c25523595bb1bc
I20260808 15:59:32.249154 12481 raft_consensus.cc:2726] T 6be9303085f141188282bd5275991d86 P 3cba87db91c74ef3b05a725a3d686043 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 15:59:32.728580 12482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:32.728194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:33437)
0808 15:59:32.728428 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:32.728481 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":70,"threads_started":1}
I20260808 15:59:32.852243 12483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:32.851811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:48151)
0808 15:59:32.852071 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:32.852150 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":103,"threads_started":1}
I20260808 15:59:33.036299 12484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:33.035855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:54899)
0808 15:59:33.036149 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:33.036205 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":93,"threads_started":1}
I20260808 15:59:33.729892 12487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:33.729489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.1:45297)
0808 15:59:33.729744 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:33.729798 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":89,"threads_started":1}
I20260808 15:59:33.853336 12488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:33.852944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.2:55399)
0808 15:59:33.853189 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:33.853242 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":86,"threads_started":1}
I20260808 15:59:34.020221 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 11773
I20260808 15:59:34.037683 12489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:34.037144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:36847 (local address 127.19.93.3:33737)
0808 15:59:34.037493 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:34.037579 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:36847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":73,"threads_started":1}
I20260808 15:59:34.039063 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 12015
I20260808 15:59:34.049810 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 12221
2026-08-08T15:59:34Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19217 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:59:34 dist-test-slave-lgr5 krb5kdc[12495](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:59:34 dist-test-slave-lgr5 krb5kdc[12495](info): set up 2 sockets
Aug 08 15:59:34 dist-test-slave-lgr5 krb5kdc[12495](info): commencing operation
krb5kdc: starting...
W20260808 15:59:35.201624 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 15:59:35 dist-test-slave-lgr5 krb5kdc[12495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:59:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:59:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 15:59:35.313113 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:46011
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:46011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:35.420840 12516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:35.421079 12516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:35.421118 12516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:35.424943 12516 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 15:59:35.424985 12516 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 15:59:35.424999 12516 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 15:59:35.425011 12516 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:59:35.425032 12516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:35.425064 12516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:35.425083 12516 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:59:35.425096 12516 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:59:35.430326 12516 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:46011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:46011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:35.431675 12516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:35.432930 12516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:35.443089 12527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:35.443107 12525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:35.443111 12531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:35.443154 12516 server_base.cc:1034] running on GCE node
I20260808 15:59:35.443944 12516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:35.444985 12516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:35.446142 12516 hybrid_clock.cc:648] HybridClock initialized: now 1786204775446129 us; error 24 us; skew 500 ppm
Aug 08 15:59:35 dist-test-slave-lgr5 krb5kdc[12495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204775, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:35.448612 12516 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:59:35.449442 12516 webserver.cc:460] Webserver started at http://127.19.93.62:45339/ using document root <none> and password file <none>
I20260808 15:59:35.449934 12516 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:35.449999 12516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:35.450192 12516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:59:35.452143 12516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "7383fc54fed2437fad56e7c5dc04056c"
format_stamp: "Formatted at 2026-08-08 15:59:35 on dist-test-slave-lgr5"
server_key: "53b165c79e46826b7796a6ace5618d0f"
server_key_iv: "59a10af757b533042c3d02c3a9ce00ec"
server_key_version: "encryptionkey@0"
I20260808 15:59:35.452677 12516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "7383fc54fed2437fad56e7c5dc04056c"
format_stamp: "Formatted at 2026-08-08 15:59:35 on dist-test-slave-lgr5"
server_key: "53b165c79e46826b7796a6ace5618d0f"
server_key_iv: "59a10af757b533042c3d02c3a9ce00ec"
server_key_version: "encryptionkey@0"
I20260808 15:59:35.456056 12516 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.002s
I20260808 15:59:35.458266 12539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:35.459422 12516 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:35.459542 12516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "7383fc54fed2437fad56e7c5dc04056c"
format_stamp: "Formatted at 2026-08-08 15:59:35 on dist-test-slave-lgr5"
server_key: "53b165c79e46826b7796a6ace5618d0f"
server_key_iv: "59a10af757b533042c3d02c3a9ce00ec"
server_key_version: "encryptionkey@0"
I20260808 15:59:35.459626 12516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:35.474185 12516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:35.476590 12516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:35.476744 12516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:35.483053 12516 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:46011
I20260808 15:59:35.483300 12616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:46011 every 8 connection(s)
I20260808 15:59:35.483891 12516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:59:35.486464 12618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:35.488153 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 12516
I20260808 15:59:35.488284 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 15:59:35.488611 19828 external_mini_cluster.cc:1428] Setting key 799b4fedb46ca8415dbc8c86cf4ba725
I20260808 15:59:35.492743 12618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Bootstrap starting.
I20260808 15:59:35.495178 12618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:35.496028 12618 log.cc:824] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Log is configured to *not* fsync() on all Append() calls
Aug 08 15:59:35 dist-test-slave-lgr5 krb5kdc[12495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:35.497897 12618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: No bootstrap required, opened a new log
I20260808 15:59:35.501272 12618 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } }
I20260808 15:59:35.501502 12618 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:35.501582 12618 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7383fc54fed2437fad56e7c5dc04056c, State: Initialized, Role: FOLLOWER
I20260808 15:59:35.501996 12618 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } }
I20260808 15:59:35.502058 12631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:35.489884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33212 (local address 127.19.93.62:46011)
0808 15:59:35.490286 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:35.490303 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:35.490337 (+ 34us) server_negotiation.cc:407] Connection header received
0808 15:59:35.490981 (+ 644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:35.490996 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:35.491291 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:35.491558 (+ 267us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:35.492432 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:35.493426 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:35.494595 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:35.495043 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:35.495170 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:35.497711 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:35.497716 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:35.497728 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:35.497753 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:35.499296 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:35.499717 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:35.499722 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:35.499726 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:35.499835 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:35.500113 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:35.500117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:35.500118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:35.500490 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:35.500689 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:35.500957 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 15:59:35.501239 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":105,"threads_started":1}
I20260808 15:59:35.502127 12618 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:59:35.502188 12618 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:59:35.502279 12618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:35.503091 12618 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } }
I20260808 15:59:35.503391 12618 leader_election.cc:302] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7383fc54fed2437fad56e7c5dc04056c; no voters:
I20260808 15:59:35.503681 12618 leader_election.cc:288] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:59:35.503784 12635 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:59:35.503994 12635 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 1 LEADER]: Becoming Leader. State: Replica: 7383fc54fed2437fad56e7c5dc04056c, State: Running, Role: LEADER
I20260808 15:59:35.504375 12635 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } }
I20260808 15:59:35.504839 12618 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:59:35.505885 12636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7383fc54fed2437fad56e7c5dc04056c. Latest consensus state: current_term: 1 leader_uuid: "7383fc54fed2437fad56e7c5dc04056c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } } }
I20260808 15:59:35.506021 12636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:35.506299 12637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7383fc54fed2437fad56e7c5dc04056c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } } }
I20260808 15:59:35.506377 12637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:35.507006 12646 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:59:35.509526 12646 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:59:35.514449 12646 catalog_manager.cc:1347] Generated new cluster ID: 70ebb446e82e465aa78a0b8bcd73ad82
I20260808 15:59:35.514508 12646 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:59:35.534081 12646 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:59:35.535226 12646 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:59:35.550714 12646 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Generated new TSK 0
I20260808 15:59:35.551437 12646 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 15:59:35.584221 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:46011
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:35.691184 12665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:35.691417 12665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:35.691457 12665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:35.695348 12665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:35.695400 12665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:35.695456 12665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:59:35.700485 12665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:46011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:35.701395 12665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:35.702327 12665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:35.711334 12672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:35.711431 12665 server_base.cc:1034] running on GCE node
W20260808 15:59:35.711302 12674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:35.711320 12678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:35.711972 12665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:35.712574 12665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:35.713730 12665 hybrid_clock.cc:648] HybridClock initialized: now 1786204775713707 us; error 40 us; skew 500 ppm
Aug 08 15:59:35 dist-test-slave-lgr5 krb5kdc[12495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204775, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:35.716362 12665 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:59:35.717197 12665 webserver.cc:460] Webserver started at http://127.19.93.1:41441/ using document root <none> and password file <none>
I20260808 15:59:35.717721 12665 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:35.717780 12665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:35.717976 12665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:59:35.719947 12665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "7a1ba621591a44129a55444eea0c9a2b"
format_stamp: "Formatted at 2026-08-08 15:59:35 on dist-test-slave-lgr5"
server_key: "a3bf059355e4bc2397fa1bf109d9da24"
server_key_iv: "bf0ed66fb5888965ded188c5f1fcc9f5"
server_key_version: "encryptionkey@0"
I20260808 15:59:35.720531 12665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "7a1ba621591a44129a55444eea0c9a2b"
format_stamp: "Formatted at 2026-08-08 15:59:35 on dist-test-slave-lgr5"
server_key: "a3bf059355e4bc2397fa1bf109d9da24"
server_key_iv: "bf0ed66fb5888965ded188c5f1fcc9f5"
server_key_version: "encryptionkey@0"
I20260808 15:59:35.723970 12665 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:59:35.726173 12690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:35.727258 12665 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:35.727361 12665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "7a1ba621591a44129a55444eea0c9a2b"
format_stamp: "Formatted at 2026-08-08 15:59:35 on dist-test-slave-lgr5"
server_key: "a3bf059355e4bc2397fa1bf109d9da24"
server_key_iv: "bf0ed66fb5888965ded188c5f1fcc9f5"
server_key_version: "encryptionkey@0"
I20260808 15:59:35.727456 12665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:35.747159 12665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:35.750025 12665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:35.750186 12665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:35.750725 12665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:35.751467 12665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:35.751513 12665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:35.751565 12665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:35.751595 12665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:35.759590 12665 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:37751
I20260808 15:59:35.759615 12850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:37751 every 8 connection(s)
I20260808 15:59:35.760397 12665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
Aug 08 15:59:35 dist-test-slave-lgr5 krb5kdc[12495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204775, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:35.769567 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 12665
I20260808 15:59:35.769690 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 15:59:35.770030 19828 external_mini_cluster.cc:1428] Setting key 89952fb97fce9609bdd031db23f3f00e
I20260808 15:59:35.772778 12631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:35.762087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:51089 (local address 127.19.93.62:46011)
0808 15:59:35.762214 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:35.762218 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:35.763000 (+ 782us) server_negotiation.cc:407] Connection header received
0808 15:59:35.764289 (+ 1289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:35.764293 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:35.764352 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:35.764419 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:35.765451 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:35.765970 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:35.766982 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:35.767191 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:35.767256 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:35.769492 (+ 2236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:35.769497 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:35.769499 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:35.769530 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:35.770811 (+ 1281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:35.771339 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:35.771341 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:35.771342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:35.771422 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:35.771747 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:35.771751 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:35.771753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:35.771961 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:35.772050 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:35.772517 (+ 467us) server_negotiation.cc:299] Negotiation successful
0808 15:59:35.772631 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 15:59:35.773413 12854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:35.762401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:51089)
0808 15:59:35.762848 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:35.762888 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:35.764057 (+ 1169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:35.764559 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:35.764565 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:35.764878 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:35.765339 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:35.765352 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:35.766068 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:35.766071 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:35.766895 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:35.766904 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:35.767293 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:35.767296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:35.767425 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:35.767929 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:35.767943 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:35.769321 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:35.770912 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:35.770917 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:35.770930 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:35.771240 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:35.771516 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:35.771519 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:35.771520 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:35.771660 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:35.772053 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:35.772058 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:35.772298 (+ 240us) client_negotiation.cc:769] Sending connection context
0808 15:59:35.772443 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 15:59:35.772676 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":135,"threads_started":1}
I20260808 15:59:35.774731 12852 heartbeater.cc:347] Connected to a master server at 127.19.93.62:46011
I20260808 15:59:35.774951 12852 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:35.775453 12852 heartbeater.cc:511] Master 127.19.93.62:46011 requested a full tablet report, sending...
I20260808 15:59:35.776913 12564 ts_manager.cc:194] Registered new tserver with Master: 7a1ba621591a44129a55444eea0c9a2b (127.19.93.1:37751)
I20260808 15:59:35.777987 12564 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:51089
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 15:59:35.795789 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:46011
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:35.901563 12859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:35.901794 12859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:35.901832 12859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:35.905805 12859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:35.905854 12859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:35.905922 12859 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:59:35.910969 12859 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:46011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12859
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:35.911892 12859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:35.912843 12859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:35.921700 12864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:35.921751 12867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:35.921733 12865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:35.921875 12859 server_base.cc:1034] running on GCE node
I20260808 15:59:35.922319 12859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:35.922863 12859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:35.924013 12859 hybrid_clock.cc:648] HybridClock initialized: now 1786204775923996 us; error 29 us; skew 500 ppm
Aug 08 15:59:35 dist-test-slave-lgr5 krb5kdc[12495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204775, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:35.926478 12859 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:59:35.927227 12859 webserver.cc:460] Webserver started at http://127.19.93.2:37711/ using document root <none> and password file <none>
I20260808 15:59:35.927695 12859 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:35.927749 12859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:35.927906 12859 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:59:35.929787 12859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "16b20ddd655f4cc5b68a7fcb83232d86"
format_stamp: "Formatted at 2026-08-08 15:59:35 on dist-test-slave-lgr5"
server_key: "4a3fa8642b6d36a510c1156790e2f679"
server_key_iv: "5000db7e62ed742e1ec0110f6fd950f3"
server_key_version: "encryptionkey@0"
I20260808 15:59:35.930317 12859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "16b20ddd655f4cc5b68a7fcb83232d86"
format_stamp: "Formatted at 2026-08-08 15:59:35 on dist-test-slave-lgr5"
server_key: "4a3fa8642b6d36a510c1156790e2f679"
server_key_iv: "5000db7e62ed742e1ec0110f6fd950f3"
server_key_version: "encryptionkey@0"
I20260808 15:59:35.933771 12859 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:59:35.935917 12874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:35.937034 12859 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:35.937137 12859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "16b20ddd655f4cc5b68a7fcb83232d86"
format_stamp: "Formatted at 2026-08-08 15:59:35 on dist-test-slave-lgr5"
server_key: "4a3fa8642b6d36a510c1156790e2f679"
server_key_iv: "5000db7e62ed742e1ec0110f6fd950f3"
server_key_version: "encryptionkey@0"
I20260808 15:59:35.937223 12859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:35.949633 12859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:35.952036 12859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:35.952250 12859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:35.952745 12859 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:35.953481 12859 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:35.953526 12859 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:35.953575 12859 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:35.953601 12859 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:35.961644 12859 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:40189
I20260808 15:59:35.961669 13038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:40189 every 8 connection(s)
I20260808 15:59:35.962428 12859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
Aug 08 15:59:35 dist-test-slave-lgr5 krb5kdc[12495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204775, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:35.971165 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 12859
I20260808 15:59:35.971289 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 15:59:35.971601 19828 external_mini_cluster.cc:1428] Setting key 6015824e01471c8f3aeb3f4dbac8dc53
I20260808 15:59:35.976153 12631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:35.964119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:55771 (local address 127.19.93.62:46011)
0808 15:59:35.964243 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:35.964247 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:35.965025 (+ 778us) server_negotiation.cc:407] Connection header received
0808 15:59:35.966249 (+ 1224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:35.966253 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:35.966308 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:35.966382 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:35.967503 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:35.968043 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:35.969166 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:35.969387 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:35.969476 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:35.971864 (+ 2388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:35.971868 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:35.971871 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:35.971915 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:35.973684 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:35.974286 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:35.974290 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:35.974292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:35.974410 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:35.974840 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:35.974844 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:35.974845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:35.975098 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:35.975192 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:35.975844 (+ 652us) server_negotiation.cc:299] Negotiation successful
0808 15:59:35.975966 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 15:59:35.977138 13041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:35.964474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:55771)
0808 15:59:35.964891 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:35.964930 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:35.966050 (+ 1120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:35.966565 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:35.966571 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:35.966909 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:35.967359 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:35.967373 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:35.968183 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:35.968187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:35.969047 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:35.969057 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:35.969520 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:35.969524 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:35.969688 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:35.970191 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:35.970207 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:35.971677 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:35.973814 (+ 2137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:35.973820 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:35.973833 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:35.974165 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:35.974540 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:35.974543 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:35.974546 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:35.974723 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:35.975253 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:35.975259 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:35.975572 (+ 313us) client_negotiation.cc:769] Sending connection context
0808 15:59:35.975769 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 15:59:35.976109 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":111,"threads_started":1}
I20260808 15:59:35.978609 13039 heartbeater.cc:347] Connected to a master server at 127.19.93.62:46011
I20260808 15:59:35.978832 13039 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:35.979315 13039 heartbeater.cc:511] Master 127.19.93.62:46011 requested a full tablet report, sending...
I20260808 15:59:35.980688 12564 ts_manager.cc:194] Registered new tserver with Master: 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189)
I20260808 15:59:35.981261 12564 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:55771
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 15:59:35.998344 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:46011
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:36.106909 13046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:36.107158 13046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:36.107218 13046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:36.111147 13046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:36.111204 13046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:36.111277 13046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:59:36.116248 13046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:46011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:36.117169 13046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:36.118178 13046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:36.127295 13061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:36.127291 13057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:36.127413 13058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:36.127689 13046 server_base.cc:1034] running on GCE node
I20260808 15:59:36.128113 13046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:36.128698 13046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:36.129848 13046 hybrid_clock.cc:648] HybridClock initialized: now 1786204776129826 us; error 40 us; skew 500 ppm
Aug 08 15:59:36 dist-test-slave-lgr5 krb5kdc[12495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204776, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:36.132541 13046 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:59:36.133307 13046 webserver.cc:460] Webserver started at http://127.19.93.3:43945/ using document root <none> and password file <none>
I20260808 15:59:36.133805 13046 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:36.133860 13046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:36.134032 13046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:59:36.135921 13046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "f52c10e78aa6423d9a44cd49ac3798c8"
format_stamp: "Formatted at 2026-08-08 15:59:36 on dist-test-slave-lgr5"
server_key: "95f8a5cd45bd80a46b7962590f77955b"
server_key_iv: "a62af0645acbf642fc91c7f09e4115cf"
server_key_version: "encryptionkey@0"
I20260808 15:59:36.136472 13046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "f52c10e78aa6423d9a44cd49ac3798c8"
format_stamp: "Formatted at 2026-08-08 15:59:36 on dist-test-slave-lgr5"
server_key: "95f8a5cd45bd80a46b7962590f77955b"
server_key_iv: "a62af0645acbf642fc91c7f09e4115cf"
server_key_version: "encryptionkey@0"
I20260808 15:59:36.139850 13046 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:59:36.142139 13073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:36.143251 13046 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:36.143356 13046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "f52c10e78aa6423d9a44cd49ac3798c8"
format_stamp: "Formatted at 2026-08-08 15:59:36 on dist-test-slave-lgr5"
server_key: "95f8a5cd45bd80a46b7962590f77955b"
server_key_iv: "a62af0645acbf642fc91c7f09e4115cf"
server_key_version: "encryptionkey@0"
I20260808 15:59:36.143455 13046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:36.165705 13046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:36.171631 13046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:36.171808 13046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:36.172472 13046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:36.173529 13046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:36.173593 13046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:36.173646 13046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:36.173668 13046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:36.186596 13046 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:36355
I20260808 15:59:36.186652 13244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:36355 every 8 connection(s)
I20260808 15:59:36.187664 13046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:59:36.194015 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 13046
I20260808 15:59:36.194131 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 15:59:36.194424 19828 external_mini_cluster.cc:1428] Setting key bfd28fe76f97aa8e41534873255dbf71
Aug 08 15:59:36 dist-test-slave-lgr5 krb5kdc[12495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204776, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:36.203500 12631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:36.189826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:32855 (local address 127.19.93.62:46011)
0808 15:59:36.189962 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:36.189967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:36.190986 (+ 1019us) server_negotiation.cc:407] Connection header received
0808 15:59:36.192670 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:36.192675 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:36.192735 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:36.192811 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:36.194282 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.194927 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.196695 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.196923 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.197005 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:36.199618 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:36.199621 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:36.199623 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:36.199646 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:36.201284 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:36.201878 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:36.201881 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:36.201883 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:36.201964 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:36.202326 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:36.202329 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:36.202331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:36.202537 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:36.202632 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:36.203215 (+ 583us) server_negotiation.cc:299] Negotiation successful
0808 15:59:36.203343 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 15:59:36.204547 13249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:36.190285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:32855)
0808 15:59:36.190827 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:36.190885 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:36.192437 (+ 1552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:36.193084 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:36.193090 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:36.193465 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:36.194127 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:36.194149 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.195073 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.195077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:36.196544 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:36.196557 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.197074 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.197079 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:36.197291 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:36.197882 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:36.197902 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:36.199471 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:36.201406 (+ 1935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:36.201411 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:36.201425 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:36.201776 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:36.202057 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:36.202060 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:36.202062 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:36.202241 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:36.202641 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:36.202647 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:36.202951 (+ 304us) client_negotiation.cc:769] Sending connection context
0808 15:59:36.203168 (+ 217us) client_negotiation.cc:240] Negotiation successful
0808 15:59:36.203493 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":132,"threads_started":1}
I20260808 15:59:36.205607 13246 heartbeater.cc:347] Connected to a master server at 127.19.93.62:46011
I20260808 15:59:36.205822 13246 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:36.206307 13246 heartbeater.cc:511] Master 127.19.93.62:46011 requested a full tablet report, sending...
I20260808 15:59:36.207474 12562 ts_manager.cc:194] Registered new tserver with Master: f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3:36355)
I20260808 15:59:36.208022 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:59:36.208300 12562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:32855
I20260808 15:59:36.216307 12631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:36.210097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33220 (local address 127.19.93.62:46011)
0808 15:59:36.210211 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:36.210215 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:36.210393 (+ 178us) server_negotiation.cc:407] Connection header received
0808 15:59:36.210478 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:36.210481 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:36.210524 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:36.210600 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:36.211136 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.211600 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.212411 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.212613 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.212684 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:36.213806 (+ 1122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:36.213809 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:36.213811 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:36.213831 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:36.215039 (+ 1208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:36.215390 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:36.215392 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:36.215393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:36.215457 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:36.215627 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:36.215629 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:36.215630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:36.215805 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:36.215903 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:36.216111 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 15:59:36.216206 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:59:36.218711 12562 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33220:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:59:36.221583 12562 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:59:36.234797 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:36.229165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:36355 (local address 127.0.0.1:38998)
0808 15:59:36.229611 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:36.229656 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:36.229774 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:36.230636 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:36.230642 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:36.230665 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:36.230806 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:36.230813 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.232394 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.232397 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:36.233508 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:36.233517 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.234289 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.234293 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:36.234405 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:36.234442 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 15:59:36.234549 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 15:59:36.234660 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":1,"thread_start_us":62,"threads_started":1}
I20260808 15:59:36.235023 13267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:36.229359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:40189 (local address 127.0.0.1:59500)
0808 15:59:36.229808 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:36.229820 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:36.229922 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:36.231008 (+ 1086us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:36.231011 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:36.231028 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:36.231141 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:36.231149 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.232600 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.232603 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:36.233580 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:36.233592 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.234544 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.234548 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:36.234638 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:36.234659 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 15:59:36.234730 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 15:59:36.234787 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":85,"threads_started":1}
I20260808 15:59:36.235246 13269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:36.229802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:37751 (local address 127.0.0.1:39768)
0808 15:59:36.230109 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:36.230120 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:36.230200 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:36.230952 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:36.230955 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:36.230975 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:36.231075 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:36.231081 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.232125 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.232129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:36.233425 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:36.233436 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.234668 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.234671 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:36.234759 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:36.234783 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:59:36.234855 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 15:59:36.235124 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":104,"threads_started":1}
I20260808 15:59:36.235261 13270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:36.230128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39768 (local address 127.19.93.1:37751)
0808 15:59:36.230489 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:36.230503 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:36.230525 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:59:36.230599 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:36.230604 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:36.230819 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:36.230966 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:36.231176 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.231992 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.233565 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.234364 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.234467 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:36.234602 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:36.234897 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 15:59:36.234990 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":113,"threads_started":1}
I20260808 15:59:36.235409 13266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:36.229281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38998 (local address 127.19.93.3:36355)
0808 15:59:36.230146 (+ 865us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:36.230157 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:36.230179 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:59:36.230247 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:36.230253 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:36.230450 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:36.230989 (+ 539us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:36.231124 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.232262 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.233605 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.234178 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.234275 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:36.234413 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:36.235189 (+ 776us) server_negotiation.cc:299] Negotiation successful
0808 15:59:36.235284 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":769,"thread_start_us":111,"threads_started":1}
I20260808 15:59:36.235437 13268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:36.229763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59500 (local address 127.19.93.2:40189)
0808 15:59:36.230578 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:36.230589 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:36.230610 (+ 21us) server_negotiation.cc:407] Connection header received
0808 15:59:36.230677 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:36.230682 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:36.230854 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:36.231283 (+ 429us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:36.231432 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.232483 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.233696 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.234451 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.234540 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:36.234648 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:36.234765 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 15:59:36.235189 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":114,"threads_started":1}
I20260808 15:59:36.238034 13143 tablet_service.cc:1467] Processing CreateTablet for tablet 60972722d7d24725af27d3470ce9bbef (DEFAULT_TABLE table=test-table [id=7add6486fab04e839c38d6ffa9a28f14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:59:36.238152 12752 tablet_service.cc:1467] Processing CreateTablet for tablet 60972722d7d24725af27d3470ce9bbef (DEFAULT_TABLE table=test-table [id=7add6486fab04e839c38d6ffa9a28f14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:59:36.238135 12943 tablet_service.cc:1467] Processing CreateTablet for tablet 60972722d7d24725af27d3470ce9bbef (DEFAULT_TABLE table=test-table [id=7add6486fab04e839c38d6ffa9a28f14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:59:36.238974 13143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60972722d7d24725af27d3470ce9bbef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:36.239122 12943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60972722d7d24725af27d3470ce9bbef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:36.239122 12752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60972722d7d24725af27d3470ce9bbef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:36.245601 13271 tablet_bootstrap.cc:492] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8: Bootstrap starting.
I20260808 15:59:36.246202 13272 tablet_bootstrap.cc:492] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: Bootstrap starting.
I20260808 15:59:36.247913 13272 tablet_bootstrap.cc:654] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:36.247931 13271 tablet_bootstrap.cc:654] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:36.248405 13273 tablet_bootstrap.cc:492] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86: Bootstrap starting.
I20260808 15:59:36.248790 13271 log.cc:824] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:36.248878 13272 log.cc:824] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:36.250598 13273 tablet_bootstrap.cc:654] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:36.250643 13271 tablet_bootstrap.cc:492] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8: No bootstrap required, opened a new log
I20260808 15:59:36.250641 13272 tablet_bootstrap.cc:492] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: No bootstrap required, opened a new log
I20260808 15:59:36.250823 13271 ts_tablet_manager.cc:1397] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.005s
I20260808 15:59:36.250823 13272 ts_tablet_manager.cc:1397] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 15:59:36.251340 13273 log.cc:824] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:36.252836 13273 tablet_bootstrap.cc:492] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86: No bootstrap required, opened a new log
I20260808 15:59:36.253000 13273 ts_tablet_manager.cc:1397] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 15:59:36.254488 13271 raft_consensus.cc:348] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:36.254474 13272 raft_consensus.cc:348] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:36.254730 13271 raft_consensus.cc:374] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:36.254730 13272 raft_consensus.cc:374] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:36.254784 13272 raft_consensus.cc:729] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1ba621591a44129a55444eea0c9a2b, State: Initialized, Role: FOLLOWER
I20260808 15:59:36.254812 13271 raft_consensus.cc:729] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f52c10e78aa6423d9a44cd49ac3798c8, State: Initialized, Role: FOLLOWER
I20260808 15:59:36.255256 13271 consensus_queue.cc:260] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:36.255256 13272 consensus_queue.cc:260] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:36.255946 13246 heartbeater.cc:503] Master 127.19.93.62:46011 was elected leader, sending a full tablet report...
I20260808 15:59:36.256237 13271 ts_tablet_manager.cc:1428] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 15:59:36.256229 12852 heartbeater.cc:503] Master 127.19.93.62:46011 was elected leader, sending a full tablet report...
I20260808 15:59:36.256237 13272 ts_tablet_manager.cc:1428] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 15:59:36.255736 13273 raft_consensus.cc:348] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:36.257056 13273 raft_consensus.cc:374] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:36.257154 13273 raft_consensus.cc:729] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16b20ddd655f4cc5b68a7fcb83232d86, State: Initialized, Role: FOLLOWER
I20260808 15:59:36.257817 13273 consensus_queue.cc:260] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:36.258415 13039 heartbeater.cc:503] Master 127.19.93.62:46011 was elected leader, sending a full tablet report...
I20260808 15:59:36.258635 13273 ts_tablet_manager.cc:1428] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260808 15:59:36.261529 12853 tablet.cc:2369] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:59:36.438825 13248 tablet.cc:2369] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:59:36.460844 13281 raft_consensus.cc:482] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:59:36.461027 13281 raft_consensus.cc:504] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:36.462212 13281 leader_election.cc:288] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3:36355), 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189)
W20260808 15:59:36.463474 13040 tablet.cc:2369] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:59:36.465993 13268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:36.462531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:57661 (local address 127.19.93.2:40189)
0808 15:59:36.462654 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:36.462659 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:36.462735 (+ 76us) server_negotiation.cc:407] Connection header received
0808 15:59:36.462914 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:36.462918 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:36.462973 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:36.463046 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:36.463329 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.463988 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.465107 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.465487 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.465579 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:36.465643 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:36.465811 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 15:59:36.465890 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:59:36.466012 13285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:36.462395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:40189 (local address 127.19.93.1:57661)
0808 15:59:36.462642 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:36.462657 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:36.462773 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:36.463069 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:36.463072 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:36.463090 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:36.463217 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:36.463225 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.464118 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.464121 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:36.464990 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:36.464999 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.465596 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.465600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:36.465699 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:36.465723 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:59:36.465788 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 15:59:36.465857 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":75,"threads_started":1}
I20260808 15:59:36.466144 13266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:36.462723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:58965 (local address 127.19.93.3:36355)
0808 15:59:36.462856 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:36.462861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:36.462893 (+ 32us) server_negotiation.cc:407] Connection header received
0808 15:59:36.463026 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:36.463029 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:36.463079 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:36.463151 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:36.463459 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.464193 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.465220 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.465622 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.465714 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:36.465775 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:36.465944 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 15:59:36.466014 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 15:59:36.466279 13287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:36.462414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:36355 (local address 127.19.93.1:58965)
0808 15:59:36.462818 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:36.462831 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:36.462935 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:36.463199 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:36.463202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:36.463218 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:36.463346 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:36.463353 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.464301 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.464304 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:36.465095 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:36.465104 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.465736 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.465740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:36.465833 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:36.465852 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 15:59:36.465915 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 15:59:36.465982 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"mutex_wait_us":1,"thread_start_us":116,"threads_started":1}
I20260808 15:59:36.466681 12973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60972722d7d24725af27d3470ce9bbef" candidate_uuid: "7a1ba621591a44129a55444eea0c9a2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" is_pre_election: true
I20260808 15:59:36.466845 13179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60972722d7d24725af27d3470ce9bbef" candidate_uuid: "7a1ba621591a44129a55444eea0c9a2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" is_pre_election: true
I20260808 15:59:36.466997 12973 raft_consensus.cc:2454] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a1ba621591a44129a55444eea0c9a2b in term 0.
I20260808 15:59:36.467078 13179 raft_consensus.cc:2454] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a1ba621591a44129a55444eea0c9a2b in term 0.
I20260808 15:59:36.467484 12693 leader_election.cc:302] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1ba621591a44129a55444eea0c9a2b, f52c10e78aa6423d9a44cd49ac3798c8; no voters:
I20260808 15:59:36.467851 13281 raft_consensus.cc:2781] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:59:36.467935 13281 raft_consensus.cc:482] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:59:36.467988 13281 raft_consensus.cc:3037] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:36.469007 13281 raft_consensus.cc:504] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:36.469311 13281 leader_election.cc:288] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 1 election: Requested vote from peers f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3:36355), 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189)
I20260808 15:59:36.469636 12973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60972722d7d24725af27d3470ce9bbef" candidate_uuid: "7a1ba621591a44129a55444eea0c9a2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16b20ddd655f4cc5b68a7fcb83232d86"
I20260808 15:59:36.469762 13179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60972722d7d24725af27d3470ce9bbef" candidate_uuid: "7a1ba621591a44129a55444eea0c9a2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f52c10e78aa6423d9a44cd49ac3798c8"
I20260808 15:59:36.469754 12973 raft_consensus.cc:3037] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:36.469872 13179 raft_consensus.cc:3037] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:36.471026 13179 raft_consensus.cc:2454] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1ba621591a44129a55444eea0c9a2b in term 1.
I20260808 15:59:36.471026 12973 raft_consensus.cc:2454] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1ba621591a44129a55444eea0c9a2b in term 1.
I20260808 15:59:36.471335 12694 leader_election.cc:302] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 16b20ddd655f4cc5b68a7fcb83232d86, 7a1ba621591a44129a55444eea0c9a2b, f52c10e78aa6423d9a44cd49ac3798c8; no voters:
I20260808 15:59:36.471551 13281 raft_consensus.cc:2781] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:59:36.471731 13281 raft_consensus.cc:686] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [term 1 LEADER]: Becoming Leader. State: Replica: 7a1ba621591a44129a55444eea0c9a2b, State: Running, Role: LEADER
I20260808 15:59:36.472019 13281 consensus_queue.cc:237] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:36.474987 12560 catalog_manager.cc:5495] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a1ba621591a44129a55444eea0c9a2b (127.19.93.1). New cstate: current_term: 1 leader_uuid: "7a1ba621591a44129a55444eea0c9a2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } health_report { overall_health: HEALTHY } } }
I20260808 15:59:36.523775 13270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:36.520752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39780 (local address 127.19.93.1:37751)
0808 15:59:36.520866 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:36.520869 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:36.520895 (+ 26us) server_negotiation.cc:407] Connection header received
0808 15:59:36.520972 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:36.520974 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:36.521031 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:36.521125 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:59:36.521319 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.521811 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.522576 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:36.522774 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:36.522840 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:36.523067 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:59:36.523482 (+ 415us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:59:36.523571 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:36.523615 (+ 44us) server_negotiation.cc:299] Negotiation successful
0808 15:59:36.523666 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 15:59:36.529667 13179 raft_consensus.cc:1261] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8 [term 1 FOLLOWER]: Refusing update from remote peer 7a1ba621591a44129a55444eea0c9a2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:59:36.529667 12973 raft_consensus.cc:1261] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86 [term 1 FOLLOWER]: Refusing update from remote peer 7a1ba621591a44129a55444eea0c9a2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:59:36.530323 13281 consensus_queue.cc:1035] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:59:36.530510 13288 consensus_queue.cc:1035] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:59:36.546866 12564 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:59:36.546995 12564 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:59:36.549211 12564 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Sending DeleteTablet for 3 replicas of tablet 60972722d7d24725af27d3470ce9bbef
I20260808 15:59:36.549921 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 12665
I20260808 15:59:36.549893 12943 tablet_service.cc:1514] Processing DeleteTablet for tablet 60972722d7d24725af27d3470ce9bbef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:59:36 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:59500
I20260808 15:59:36.549961 12752 tablet_service.cc:1514] Processing DeleteTablet for tablet 60972722d7d24725af27d3470ce9bbef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:59:36 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:39768
I20260808 15:59:36.554196 13143 tablet_service.cc:1514] Processing DeleteTablet for tablet 60972722d7d24725af27d3470ce9bbef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:59:36 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:38998
I20260808 15:59:36.561455 13310 tablet_replica.cc:330] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86: stopping tablet replica
I20260808 15:59:36.561756 13310 raft_consensus.cc:2229] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:59:36.561854 13312 tablet_replica.cc:330] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8: stopping tablet replica
I20260808 15:59:36.562063 13310 raft_consensus.cc:2258] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:59:36.562119 13312 raft_consensus.cc:2229] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:59:36.562695 13312 raft_consensus.cc:2258] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:59:36.564392 13310 ts_tablet_manager.cc:1905] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:59:36.564673 13312 ts_tablet_manager.cc:1905] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:59:36.566573 13310 ts_tablet_manager.cc:1918] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:59:36.566663 13310 log.cc:1196] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/60972722d7d24725af27d3470ce9bbef
I20260808 15:59:36.566927 13310 ts_tablet_manager.cc:1939] T 60972722d7d24725af27d3470ce9bbef P 16b20ddd655f4cc5b68a7fcb83232d86: Deleting consensus metadata
I20260808 15:59:36.567171 13312 ts_tablet_manager.cc:1918] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:59:36.567269 13312 log.cc:1196] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/60972722d7d24725af27d3470ce9bbef
I20260808 15:59:36.567627 13312 ts_tablet_manager.cc:1939] T 60972722d7d24725af27d3470ce9bbef P f52c10e78aa6423d9a44cd49ac3798c8: Deleting consensus metadata
I20260808 15:59:36.568033 12545 catalog_manager.cc:4841] TS 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189): tablet 60972722d7d24725af27d3470ce9bbef (table test-table [id=7add6486fab04e839c38d6ffa9a28f14]) successfully deleted
I20260808 15:59:36.568674 12544 catalog_manager.cc:4841] TS f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3:36355): tablet 60972722d7d24725af27d3470ce9bbef (table test-table [id=7add6486fab04e839c38d6ffa9a28f14]) successfully deleted
W20260808 15:59:36.569893 12544 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:37751 (error 108)
I20260808 15:59:36.570647 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 12859
I20260808 15:59:36.570879 13269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:36.570593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:37751 (local address 127.0.0.1:39782)
0808 15:59:36.570727 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:36.570798 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:37751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 15:59:36.581398 12544 catalog_manager.cc:4584] TS 7a1ba621591a44129a55444eea0c9a2b (127.19.93.1:37751): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 60972722d7d24725af27d3470ce9bbef: Network error: Client connection negotiation failed: client connection to 127.19.93.1:37751: connect: Connection refused (error 111)
I20260808 15:59:36.586088 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 13046
I20260808 15:59:36.595934 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 12516
I20260808 15:59:56.606778 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:46011
--webserver_interface=127.19.93.62
--webserver_port=45339
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:46011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:59:56.718124 13316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:56.718346 13316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:56.718400 13316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:56.722250 13316 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 15:59:56.722294 13316 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 15:59:56.722316 13316 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 15:59:56.722332 13316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:59:56.722357 13316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:56.722388 13316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:56.722412 13316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:59:56.722440 13316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:59:56.727401 13316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:46011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:46011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=45339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:56.728312 13316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:56.729215 13316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:56.741878 13326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:56.741891 13328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:56.741878 13325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:56.742074 13316 server_base.cc:1034] running on GCE node
I20260808 15:59:56.742669 13316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:56.743677 13316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:56.744827 13316 hybrid_clock.cc:648] HybridClock initialized: now 1786204796744810 us; error 32 us; skew 500 ppm
Aug 08 15:59:56 dist-test-slave-lgr5 krb5kdc[12495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204796, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:56.747397 13316 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 15:59:56.748281 13316 webserver.cc:460] Webserver started at http://127.19.93.62:45339/ using document root <none> and password file <none>
I20260808 15:59:56.748807 13316 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:56.748878 13316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:56.752453 13316 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260808 15:59:56.754379 13339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:56.755476 13316 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:56.755599 13316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "7383fc54fed2437fad56e7c5dc04056c"
format_stamp: "Formatted at 2026-08-08 15:59:35 on dist-test-slave-lgr5"
server_key: "53b165c79e46826b7796a6ace5618d0f"
server_key_iv: "59a10af757b533042c3d02c3a9ce00ec"
server_key_version: "encryptionkey@0"
I20260808 15:59:56.756178 13316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:56.774078 13316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:56.776640 13316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:56.776798 13316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:56.783370 13316 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:46011
I20260808 15:59:56.783636 13417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:46011 every 8 connection(s)
I20260808 15:59:56.784404 13316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 15:59:56.788575 13418 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:59:56.790154 13418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Bootstrap starting.
I20260808 15:59:56.794072 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 13316
I20260808 15:59:56.794564 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:37751
--local_ip_for_outbound_sockets=127.19.93.1
--tserver_master_addrs=127.19.93.62:46011
--webserver_port=41441
--webserver_interface=127.19.93.1
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:59:56.807397 13418 log.cc:824] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:56.815887 13418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:59:56.816228 13418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Bootstrap complete.
I20260808 15:59:56.820000 13418 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } }
I20260808 15:59:56.820433 13418 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7383fc54fed2437fad56e7c5dc04056c, State: Initialized, Role: FOLLOWER
I20260808 15:59:56.820874 13418 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } }
I20260808 15:59:56.820986 13418 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:59:56.821050 13418 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:59:56.821136 13418 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 1 FOLLOWER]: Advancing to term 2
I20260808 15:59:56.822896 13418 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } }
I20260808 15:59:56.823197 13418 leader_election.cc:302] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7383fc54fed2437fad56e7c5dc04056c; no voters:
I20260808 15:59:56.823467 13418 leader_election.cc:288] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 15:59:56.823556 13424 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 2 FOLLOWER]: Leader election won for term 2
I20260808 15:59:56.823781 13424 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 2 LEADER]: Becoming Leader. State: Replica: 7383fc54fed2437fad56e7c5dc04056c, State: Running, Role: LEADER
I20260808 15:59:56.824172 13424 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } }
I20260808 15:59:56.824745 13418 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:59:56.825181 13424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7383fc54fed2437fad56e7c5dc04056c. Latest consensus state: current_term: 2 leader_uuid: "7383fc54fed2437fad56e7c5dc04056c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } } }
I20260808 15:59:56.825286 13424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:56.825498 13425 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7383fc54fed2437fad56e7c5dc04056c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } } }
I20260808 15:59:56.825614 13425 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [sys.catalog]: This master's current role is: LEADER
I20260808 15:59:56.825819 13431 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:59:56.830430 13431 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:59:56.831133 13431 catalog_manager.cc:1259] Loaded cluster ID: 70ebb446e82e465aa78a0b8bcd73ad82
I20260808 15:59:56.831180 13431 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:59:56.832919 13431 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:59:56.833487 13431 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Loaded TSK: 0
I20260808 15:59:56.845021 13431 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Generated new TSK 1
I20260808 15:59:56.845224 13431 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 15:59:56.918879 13422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:56.919106 13422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:56.919162 13422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:56.923090 13422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:56.923141 13422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:56.923213 13422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 15:59:56.928306 13422 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:37751
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=41441
--tserver_master_addrs=127.19.93.62:46011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:56.929196 13422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:56.930106 13422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:56.939306 13465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:56.939219 13462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:56.939219 13463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:56.939494 13422 server_base.cc:1034] running on GCE node
I20260808 15:59:56.939965 13422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:56.940601 13422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:56.941767 13422 hybrid_clock.cc:648] HybridClock initialized: now 1786204796941748 us; error 34 us; skew 500 ppm
Aug 08 15:59:56 dist-test-slave-lgr5 krb5kdc[12495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204796, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:56.944371 13422 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 15:59:56.945191 13422 webserver.cc:460] Webserver started at http://127.19.93.1:41441/ using document root <none> and password file <none>
I20260808 15:59:56.945690 13422 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:56.945760 13422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:56.949319 13422 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:59:56.951241 13479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:56.952461 13422 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:56.952551 13422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "7a1ba621591a44129a55444eea0c9a2b"
format_stamp: "Formatted at 2026-08-08 15:59:35 on dist-test-slave-lgr5"
server_key: "a3bf059355e4bc2397fa1bf109d9da24"
server_key_iv: "bf0ed66fb5888965ded188c5f1fcc9f5"
server_key_version: "encryptionkey@0"
I20260808 15:59:56.953075 13422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:56.976343 13422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:56.978925 13422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:56.979108 13422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:56.979682 13422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:56.980746 13491 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 15:59:56.984889 13422 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 15:59:56.984958 13422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260808 15:59:56.985028 13422 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 15:59:56.986748 13422 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 15:59:56.986793 13422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 15:59:56.987051 13491 tablet_bootstrap.cc:492] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: Bootstrap starting.
I20260808 15:59:56.996392 13422 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:37751
I20260808 15:59:56.996472 13661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:37751 every 8 connection(s)
I20260808 15:59:56.997294 13422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 15:59:57.002175 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 13422
I20260808 15:59:57.002596 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:40189
--local_ip_for_outbound_sockets=127.19.93.2
--tserver_master_addrs=127.19.93.62:46011
--webserver_port=37711
--webserver_interface=127.19.93.2
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:59:57.005690 13491 log.cc:824] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: Log is configured to *not* fsync() on all Append() calls
Aug 08 15:59:57 dist-test-slave-lgr5 krb5kdc[12495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204796, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:57.013774 13665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:56.999265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:40331)
0808 15:59:56.999825 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:56.999882 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:57.000940 (+ 1058us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:57.002136 (+ 1196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:57.002145 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:57.002635 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:57.003338 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:57.003366 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.005001 (+ 1635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.005004 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:57.005900 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:57.005910 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.006622 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.006626 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:57.006809 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.007366 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:57.007384 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:57.008821 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:57.010851 (+ 2030us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:57.010857 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:57.010870 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:57.011119 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:57.011443 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:57.011446 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:57.011448 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:57.011579 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:57.012139 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:57.012145 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:57.012404 (+ 259us) client_negotiation.cc:769] Sending connection context
0808 15:59:57.012568 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 15:59:57.012893 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":146,"threads_started":1}
I20260808 15:59:57.013763 13666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:56.999452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:40331 (local address 127.19.93.62:46011)
0808 15:59:57.000267 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:57.000280 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:57.000317 (+ 37us) server_negotiation.cc:407] Connection header received
0808 15:59:57.001363 (+ 1046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:57.001374 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:57.001669 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:57.001948 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:57.003584 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.004862 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.006019 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.006485 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.006639 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.009104 (+ 2465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:57.009109 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:57.009120 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:57.009149 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:57.010738 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:57.011226 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:57.011230 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:57.011234 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:57.011350 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:57.011667 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:57.011669 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:57.011670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:57.012005 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:57.012144 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:57.012704 (+ 560us) server_negotiation.cc:299] Negotiation successful
0808 15:59:57.012976 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":118,"threads_started":1}
I20260808 15:59:57.014578 13491 tablet_bootstrap.cc:492] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:59:57.015002 13491 tablet_bootstrap.cc:492] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: Bootstrap complete.
I20260808 15:59:57.016400 13491 ts_tablet_manager.cc:1397] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: Time spent bootstrapping tablet: real 0.030s user 0.018s sys 0.011s
I20260808 15:59:57.016573 13662 heartbeater.cc:347] Connected to a master server at 127.19.93.62:46011
I20260808 15:59:57.016784 13662 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:57.017242 13662 heartbeater.cc:511] Master 127.19.93.62:46011 requested a full tablet report, sending...
I20260808 15:59:57.019481 13368 ts_manager.cc:194] Registered new tserver with Master: 7a1ba621591a44129a55444eea0c9a2b (127.19.93.1:37751)
I20260808 15:59:57.019227 13491 raft_consensus.cc:348] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:57.019778 13491 raft_consensus.cc:729] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1ba621591a44129a55444eea0c9a2b, State: Initialized, Role: FOLLOWER
I20260808 15:59:57.020332 13491 consensus_queue.cc:260] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:57.021288 13491 ts_tablet_manager.cc:1428] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260808 15:59:57.022912 13368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:40331
I20260808 15:59:57.025465 13662 heartbeater.cc:503] Master 127.19.93.62:46011 was elected leader, sending a full tablet report...
Aug 08 15:59:57 dist-test-slave-lgr5 krb5kdc[12495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204796, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for kudu/127.19.93.1@KRBTEST.COM
I20260808 15:59:57.032652 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.022377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53782 (local address 127.19.93.1:37751)
0808 15:59:57.022950 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:57.022961 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:57.022989 (+ 28us) server_negotiation.cc:407] Connection header received
0808 15:59:57.023214 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:57.023219 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:57.023413 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:57.023546 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:57.024250 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.025261 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.026487 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.026951 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.027040 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.029472 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:57.029480 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:57.029489 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:57.029509 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:57.030872 (+ 1363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:57.031376 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:57.031402 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:57.031404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:57.031477 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:57.031728 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:57.031730 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:57.031731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:57.031931 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:57.032025 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:57.032415 (+ 390us) server_negotiation.cc:299] Negotiation successful
0808 15:59:57.032540 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":97,"threads_started":1}
I20260808 15:59:57.032670 13671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.022289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:37751 (local address 127.0.0.1:53782)
0808 15:59:57.022870 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:57.022924 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:57.023066 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:57.023554 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:57.023560 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:57.023964 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:57.024116 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:57.024125 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.025367 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.025371 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:57.026364 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:57.026376 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.027082 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.027085 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:57.027198 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.027687 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:57.027700 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:57.029334 (+ 1634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:57.030978 (+ 1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:57.030987 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:57.030993 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:57.031285 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:57.031555 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:57.031558 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:57.031560 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:57.031654 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:57.032027 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:57.032033 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:57.032191 (+ 158us) client_negotiation.cc:769] Sending connection context
0808 15:59:57.032334 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 15:59:57.032507 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":96,"threads_started":1}
I20260808 15:59:57.033561 13563 tablet_service.cc:1514] Processing DeleteTablet for tablet 60972722d7d24725af27d3470ce9bbef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:59:36 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:53782
I20260808 15:59:57.034464 13674 tablet_replica.cc:330] stopping tablet replica
I20260808 15:59:57.034713 13674 raft_consensus.cc:2229] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:59:57.034932 13674 raft_consensus.cc:2258] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:59:57.035772 13674 ts_tablet_manager.cc:1905] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:59:57.039158 13674 ts_tablet_manager.cc:1918] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:59:57.039242 13674 log.cc:1196] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal/wals/60972722d7d24725af27d3470ce9bbef
I20260808 15:59:57.039474 13674 ts_tablet_manager.cc:1939] T 60972722d7d24725af27d3470ce9bbef P 7a1ba621591a44129a55444eea0c9a2b: Deleting consensus metadata
I20260808 15:59:57.041069 13341 catalog_manager.cc:4841] TS 7a1ba621591a44129a55444eea0c9a2b (127.19.93.1:37751): tablet 60972722d7d24725af27d3470ce9bbef (table test-table [id=7add6486fab04e839c38d6ffa9a28f14]) successfully deleted
W20260808 15:59:57.119620 13668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:57.119848 13668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:57.119885 13668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:57.123682 13668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:57.123726 13668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:57.123780 13668 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 15:59:57.128953 13668 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:40189
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=37711
--tserver_master_addrs=127.19.93.62:46011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:57.129835 13668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:57.130728 13668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:57.139868 13687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:57.139906 13690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:57.139873 13688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:57.140106 13668 server_base.cc:1034] running on GCE node
I20260808 15:59:57.140558 13668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:57.141309 13668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:57.142542 13668 hybrid_clock.cc:648] HybridClock initialized: now 1786204797142495 us; error 39 us; skew 500 ppm
Aug 08 15:59:57 dist-test-slave-lgr5 krb5kdc[12495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204797, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:57.145308 13668 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 15:59:57.146131 13668 webserver.cc:460] Webserver started at http://127.19.93.2:37711/ using document root <none> and password file <none>
I20260808 15:59:57.146663 13668 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:57.146746 13668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:57.150514 13668 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:59:57.152467 13703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:57.153627 13668 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:57.153735 13668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "16b20ddd655f4cc5b68a7fcb83232d86"
format_stamp: "Formatted at 2026-08-08 15:59:35 on dist-test-slave-lgr5"
server_key: "4a3fa8642b6d36a510c1156790e2f679"
server_key_iv: "5000db7e62ed742e1ec0110f6fd950f3"
server_key_version: "encryptionkey@0"
I20260808 15:59:57.154263 13668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:57.207127 13668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:57.210197 13668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:57.210407 13668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:57.211035 13668 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:57.211941 13668 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:57.211997 13668 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:57.212056 13668 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:57.212110 13668 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:57.221257 13668 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:40189
I20260808 15:59:57.221280 13880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:40189 every 8 connection(s)
I20260808 15:59:57.222239 13668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 15:59:57.230947 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 13668
I20260808 15:59:57.231460 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:36355
--local_ip_for_outbound_sockets=127.19.93.3
--tserver_master_addrs=127.19.93.62:46011
--webserver_port=43945
--webserver_interface=127.19.93.3
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:59:57 dist-test-slave-lgr5 krb5kdc[12495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204797, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:57.235818 13666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.223911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:47247 (local address 127.19.93.62:46011)
0808 15:59:57.224053 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:57.224057 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:57.224870 (+ 813us) server_negotiation.cc:407] Connection header received
0808 15:59:57.226261 (+ 1391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:57.226265 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:57.226340 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:57.226449 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:57.227613 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.228195 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.229360 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.229597 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.229698 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.232304 (+ 2606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:57.232317 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:57.232321 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:57.232359 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:57.233895 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:57.234366 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:57.234371 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:57.234373 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:57.234482 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:57.234780 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:57.234783 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:57.234785 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:57.234990 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:57.235093 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:57.235519 (+ 426us) server_negotiation.cc:299] Negotiation successful
0808 15:59:57.235658 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 15:59:57.236567 13886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.224246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:47247)
0808 15:59:57.224713 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:57.224760 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:57.226047 (+ 1287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:57.226628 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:57.226637 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:57.226992 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:57.227448 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:57.227463 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.228322 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.228326 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:57.229215 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:57.229227 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.229746 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.229751 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:57.229931 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.230411 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:57.230428 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:57.232018 (+ 1590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:57.234013 (+ 1995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:57.234018 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:57.234028 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:57.234270 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:57.234575 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:57.234577 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:57.234578 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:57.234696 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:57.235081 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:57.235085 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:57.235289 (+ 204us) client_negotiation.cc:769] Sending connection context
0808 15:59:57.235443 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 15:59:57.235741 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":99,"threads_started":1}
I20260808 15:59:57.237639 13881 heartbeater.cc:347] Connected to a master server at 127.19.93.62:46011
I20260808 15:59:57.237851 13881 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:57.238298 13881 heartbeater.cc:511] Master 127.19.93.62:46011 requested a full tablet report, sending...
I20260808 15:59:57.239277 13368 ts_manager.cc:194] Registered new tserver with Master: 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189)
I20260808 15:59:57.239828 13368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:47247
W20260808 15:59:57.345515 13887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:59:57.345778 13887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:59:57.345867 13887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:59:57.349833 13887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:59:57.349890 13887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:59:57.349972 13887 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 15:59:57.355042 13887 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:36355
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=43945
--tserver_master_addrs=127.19.93.62:46011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:59:57.356019 13887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:59:57.357043 13887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:59:57.366257 13894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:59:57.366274 13893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:57.366345 13887 server_base.cc:1034] running on GCE node
W20260808 15:59:57.366269 13898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:59:57.366825 13887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:59:57.367429 13887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:59:57.368599 13887 hybrid_clock.cc:648] HybridClock initialized: now 1786204797368581 us; error 30 us; skew 500 ppm
Aug 08 15:59:57 dist-test-slave-lgr5 krb5kdc[12495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204797, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:59:57.371102 13887 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 15:59:57.371917 13887 webserver.cc:460] Webserver started at http://127.19.93.3:43945/ using document root <none> and password file <none>
I20260808 15:59:57.372566 13887 fs_manager.cc:359] Metadata directory not provided
I20260808 15:59:57.372658 13887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:59:57.376307 13887 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 15:59:57.378186 13910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:57.379311 13887 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:59:57.379417 13887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "f52c10e78aa6423d9a44cd49ac3798c8"
format_stamp: "Formatted at 2026-08-08 15:59:36 on dist-test-slave-lgr5"
server_key: "95f8a5cd45bd80a46b7962590f77955b"
server_key_iv: "a62af0645acbf642fc91c7f09e4115cf"
server_key_version: "encryptionkey@0"
I20260808 15:59:57.379923 13887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:59:57.393303 13887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:59:57.395731 13887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:59:57.395886 13887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:59:57.396417 13887 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:59:57.397161 13887 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:59:57.397207 13887 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:57.397255 13887 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:59:57.397285 13887 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:59:57.405411 13887 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:36355
I20260808 15:59:57.405471 14085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:36355 every 8 connection(s)
I20260808 15:59:57.406282 13887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 15:59:57.408849 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 13887
Aug 08 15:59:57 dist-test-slave-lgr5 krb5kdc[12495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204797, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 15:59:57.417420 14094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.409520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33306 (local address 127.19.93.62:46011)
0808 15:59:57.409783 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:57.409787 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:57.409829 (+ 42us) server_negotiation.cc:407] Connection header received
0808 15:59:57.409985 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:57.409988 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:57.410040 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:57.410140 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:57.410802 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.411598 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.412499 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.412838 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.412940 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.414121 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:57.414126 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:57.414128 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:57.414152 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:57.415634 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:57.416122 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:57.416126 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:57.416128 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:57.416215 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:57.416492 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:57.416494 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:57.416495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:57.416701 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:57.416921 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:57.417067 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 15:59:57.417228 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"spinlock_wait_cycles":27264,"thread_start_us":95,"threads_started":1}
I20260808 15:59:57.420044 13666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.407867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:49869 (local address 127.19.93.62:46011)
0808 15:59:57.408001 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:57.408005 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:57.408819 (+ 814us) server_negotiation.cc:407] Connection header received
0808 15:59:57.410370 (+ 1551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:57.410373 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:57.410416 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:57.410484 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:57.411777 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.412300 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.413605 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.413807 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.413888 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.416640 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:57.416643 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:57.416646 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:57.416687 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:57.418301 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:57.418743 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:57.418747 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:57.418749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:57.418825 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:57.419185 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:57.419189 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:57.419191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:57.419360 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:57.419435 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:57.419838 (+ 403us) server_negotiation.cc:299] Negotiation successful
0808 15:59:57.419925 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51,"spinlock_wait_cycles":384}
I20260808 15:59:57.420810 14091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.408202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:49869)
0808 15:59:57.408634 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:57.408700 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:57.410178 (+ 1478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:57.410650 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:57.410656 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:57.411102 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:59:57.411668 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:57.411687 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.412413 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.412416 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:57.413492 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:57.413503 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.413937 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.413942 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:57.414147 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.414770 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:59:57.414789 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:59:57.416497 (+ 1708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:59:57.418390 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:57.418396 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:57.418408 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:57.418650 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:57.418906 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:59:57.418909 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:59:57.418911 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:59:57.419085 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:59:57.419440 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:59:57.419445 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:59:57.419658 (+ 213us) client_negotiation.cc:769] Sending connection context
0808 15:59:57.419804 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 15:59:57.420027 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":107,"threads_started":1}
I20260808 15:59:57.421761 14088 heartbeater.cc:347] Connected to a master server at 127.19.93.62:46011
I20260808 15:59:57.421972 14088 heartbeater.cc:464] Registering TS with master...
I20260808 15:59:57.422410 14088 heartbeater.cc:511] Master 127.19.93.62:46011 requested a full tablet report, sending...
I20260808 15:59:57.423300 13368 ts_manager.cc:194] Registered new tserver with Master: f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3:36355)
I20260808 15:59:57.423804 13368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:49869
I20260808 15:59:57.430603 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:59:57.434302 13666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.431149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33308 (local address 127.19.93.62:46011)
0808 15:59:57.431266 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:57.431271 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:57.431422 (+ 151us) server_negotiation.cc:407] Connection header received
0808 15:59:57.431570 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:57.431573 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:57.431655 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:57.431738 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:59:57.431972 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.432477 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.433301 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.433502 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.433583 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.433858 (+ 275us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:59:57.433968 (+ 110us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 15:59:57.434196 (+ 228us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33308: token expired
Metrics: {"server-negotiator.queue_time_us":42}
W20260808 15:59:57.434363 13666 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33308: token expired
W20260808 15:59:57.434651 13254 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.19.93.62:46011)
I20260808 15:59:57.440662 13666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.434950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33322 (local address 127.19.93.62:46011)
0808 15:59:57.435068 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:57.435071 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:57.435083 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:59:57.435175 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:57.435177 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:57.435209 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:57.435268 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:59:57.435778 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.436259 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.436973 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.437168 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.437238 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.438288 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:59:57.438291 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:59:57.438292 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:59:57.438313 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:59:57.439432 (+ 1119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:57.439767 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:57.439769 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:57.439770 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:57.439832 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:59:57.440005 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:59:57.440007 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:59:57.440008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:59:57.440186 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:59:57.440279 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:57.440458 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 15:59:57.440538 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 15:59:57.442674 13368 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33322:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:59:57.445732 13368 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:59:57.452795 13563 tablet_service.cc:1467] Processing CreateTablet for tablet 949eaa07a8b24a46ba2ce014a7db2ab7 (DEFAULT_TABLE table=test-table [id=0266be67b89f4ef1914d5e5ec255080e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:59:57.453425 13563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 949eaa07a8b24a46ba2ce014a7db2ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:57.456336 13491 tablet_bootstrap.cc:492] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b: Bootstrap starting.
I20260808 15:59:57.456518 13671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.451843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:36355 (local address 127.0.0.1:54654)
0808 15:59:57.451978 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:57.451992 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:57.452062 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:57.453026 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:57.453029 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:57.453047 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:57.453131 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:57.453138 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.454274 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.454278 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:57.455177 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:57.455187 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.456123 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.456126 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:57.456217 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.456256 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 15:59:57.456332 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 15:59:57.456408 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 15:59:57.456583 14100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.451987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54654 (local address 127.19.93.3:36355)
0808 15:59:57.452434 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:57.452451 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:57.452475 (+ 24us) server_negotiation.cc:407] Connection header received
0808 15:59:57.452545 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:57.452550 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:57.452848 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:57.453270 (+ 422us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:57.453388 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.454175 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.455301 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.455971 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.456127 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.456265 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:57.456365 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 15:59:57.456459 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":186,"threads_started":1}
I20260808 15:59:57.457212 13491 tablet_bootstrap.cc:654] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:57.457967 14102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.452224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:40189 (local address 127.0.0.1:53608)
0808 15:59:57.452475 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:57.452488 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:57.452583 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:57.453511 (+ 928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:57.453514 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:57.453532 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:57.453619 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:57.453631 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.454927 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.454930 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:57.456039 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:57.456052 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.457586 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.457590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:57.457678 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.457701 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:59:57.457778 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 15:59:57.457841 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":97,"threads_started":1}
I20260808 15:59:57.458195 14104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.452727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53608 (local address 127.19.93.2:40189)
0808 15:59:57.453093 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:57.453105 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:57.453127 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:59:57.453201 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:57.453206 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:57.453371 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:57.453606 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:57.453777 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.454787 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.456230 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.457440 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.457569 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.457704 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:57.457814 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 15:59:57.457900 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":115,"threads_started":1}
I20260808 15:59:57.458637 13491 tablet_bootstrap.cc:492] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b: No bootstrap required, opened a new log
I20260808 15:59:57.458726 13491 ts_tablet_manager.cc:1397] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260808 15:59:57.459125 13491 raft_consensus.cc:348] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:57.459229 13491 raft_consensus.cc:374] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:57.459277 13491 raft_consensus.cc:729] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1ba621591a44129a55444eea0c9a2b, State: Initialized, Role: FOLLOWER
I20260808 15:59:57.459404 13491 consensus_queue.cc:260] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:57.459658 13491 ts_tablet_manager.cc:1428] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 15:59:57.459502 13983 tablet_service.cc:1467] Processing CreateTablet for tablet 949eaa07a8b24a46ba2ce014a7db2ab7 (DEFAULT_TABLE table=test-table [id=0266be67b89f4ef1914d5e5ec255080e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:59:57.460572 13983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 949eaa07a8b24a46ba2ce014a7db2ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:57.462430 13777 tablet_service.cc:1467] Processing CreateTablet for tablet 949eaa07a8b24a46ba2ce014a7db2ab7 (DEFAULT_TABLE table=test-table [id=0266be67b89f4ef1914d5e5ec255080e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:59:57.463449 13777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 949eaa07a8b24a46ba2ce014a7db2ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:59:57.468533 14108 tablet_bootstrap.cc:492] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8: Bootstrap starting.
I20260808 15:59:57.470422 14108 tablet_bootstrap.cc:654] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:57.470817 14109 tablet_bootstrap.cc:492] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86: Bootstrap starting.
I20260808 15:59:57.471487 14108 log.cc:824] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:57.473210 14108 tablet_bootstrap.cc:492] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8: No bootstrap required, opened a new log
I20260808 15:59:57.473212 14109 tablet_bootstrap.cc:654] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86: Neither blocks nor log segments found. Creating new log.
I20260808 15:59:57.473387 14108 ts_tablet_manager.cc:1397] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 15:59:57.473927 14109 log.cc:824] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86: Log is configured to *not* fsync() on all Append() calls
I20260808 15:59:57.475564 14109 tablet_bootstrap.cc:492] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86: No bootstrap required, opened a new log
I20260808 15:59:57.475741 14109 ts_tablet_manager.cc:1397] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 15:59:57.476279 14108 raft_consensus.cc:348] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:57.476493 14108 raft_consensus.cc:374] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:57.476528 14108 raft_consensus.cc:729] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f52c10e78aa6423d9a44cd49ac3798c8, State: Initialized, Role: FOLLOWER
I20260808 15:59:57.476923 14108 consensus_queue.cc:260] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:57.477471 14088 heartbeater.cc:503] Master 127.19.93.62:46011 was elected leader, sending a full tablet report...
I20260808 15:59:57.477814 14108 ts_tablet_manager.cc:1428] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260808 15:59:57.479115 14109 raft_consensus.cc:348] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:57.479389 14109 raft_consensus.cc:374] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:59:57.479454 14109 raft_consensus.cc:729] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16b20ddd655f4cc5b68a7fcb83232d86, State: Initialized, Role: FOLLOWER
I20260808 15:59:57.479867 14109 consensus_queue.cc:260] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:57.480443 13881 heartbeater.cc:503] Master 127.19.93.62:46011 was elected leader, sending a full tablet report...
I20260808 15:59:57.480859 14109 ts_tablet_manager.cc:1428] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260808 15:59:57.487272 14114 raft_consensus.cc:482] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:59:57.487439 14114 raft_consensus.cc:504] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:57.488466 14114 leader_election.cc:288] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189), 7a1ba621591a44129a55444eea0c9a2b (127.19.93.1:37751)
I20260808 15:59:57.492905 14104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.488738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:57183 (local address 127.19.93.2:40189)
0808 15:59:57.488868 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:57.488873 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:57.488935 (+ 62us) server_negotiation.cc:407] Connection header received
0808 15:59:57.489058 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:57.489060 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:57.489102 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:57.489190 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:57.489405 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.490141 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.491602 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.492257 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.492394 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.492476 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:57.492740 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 15:59:57.492810 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:59:57.492908 14091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.488632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:40189 (local address 127.19.93.3:57183)
0808 15:59:57.488872 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:57.488886 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:57.488975 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:57.489202 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:57.489204 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:57.489217 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:57.489307 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:57.489311 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.490244 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.490246 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:57.491471 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:57.491483 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.492495 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.492499 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:57.492615 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.492639 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:59:57.492707 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 15:59:57.492781 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":45}
I20260808 15:59:57.493296 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.488804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:52989 (local address 127.19.93.1:37751)
0808 15:59:57.488933 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:57.488938 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:57.489119 (+ 181us) server_negotiation.cc:407] Connection header received
0808 15:59:57.489196 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:57.489199 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:57.489265 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:57.489359 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:59:57.489572 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.490319 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.491649 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.492316 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.492412 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.492672 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:57.493103 (+ 431us) server_negotiation.cc:299] Negotiation successful
0808 15:59:57.493180 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:59:57.493438 13811 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949eaa07a8b24a46ba2ce014a7db2ab7" candidate_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" is_pre_election: true
I20260808 15:59:57.493705 14116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.488689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:37751 (local address 127.19.93.3:52989)
0808 15:59:57.489021 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:57.489033 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:59:57.489125 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:59:57.489377 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:59:57.489380 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:59:57.489395 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:59:57.489477 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:57.489481 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.490405 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.490408 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:57.491547 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:59:57.491555 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.492747 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.492751 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:59:57.492854 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.492879 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 15:59:57.493481 (+ 602us) client_negotiation.cc:240] Negotiation successful
0808 15:59:57.493572 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":4,"thread_start_us":90,"threads_started":1}
I20260808 15:59:57.493686 13811 raft_consensus.cc:2454] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f52c10e78aa6423d9a44cd49ac3798c8 in term 0.
I20260808 15:59:57.494102 13914 leader_election.cc:302] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b20ddd655f4cc5b68a7fcb83232d86, f52c10e78aa6423d9a44cd49ac3798c8; no voters:
I20260808 15:59:57.494331 14114 raft_consensus.cc:2781] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:59:57.494306 13591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949eaa07a8b24a46ba2ce014a7db2ab7" candidate_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1ba621591a44129a55444eea0c9a2b" is_pre_election: true
I20260808 15:59:57.494418 14114 raft_consensus.cc:482] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:59:57.494472 14114 raft_consensus.cc:3037] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:57.494586 13591 raft_consensus.cc:2454] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f52c10e78aa6423d9a44cd49ac3798c8 in term 0.
I20260808 15:59:57.495586 14114 raft_consensus.cc:504] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:57.495859 14114 leader_election.cc:288] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [CANDIDATE]: Term 1 election: Requested vote from peers 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189), 7a1ba621591a44129a55444eea0c9a2b (127.19.93.1:37751)
I20260808 15:59:57.496194 13811 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949eaa07a8b24a46ba2ce014a7db2ab7" candidate_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16b20ddd655f4cc5b68a7fcb83232d86"
I20260808 15:59:57.496196 13591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949eaa07a8b24a46ba2ce014a7db2ab7" candidate_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1ba621591a44129a55444eea0c9a2b"
I20260808 15:59:57.496311 13811 raft_consensus.cc:3037] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:57.496311 13591 raft_consensus.cc:3037] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:59:57.497475 13811 raft_consensus.cc:2454] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f52c10e78aa6423d9a44cd49ac3798c8 in term 1.
I20260808 15:59:57.497475 13591 raft_consensus.cc:2454] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f52c10e78aa6423d9a44cd49ac3798c8 in term 1.
I20260808 15:59:57.497743 13914 leader_election.cc:302] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 16b20ddd655f4cc5b68a7fcb83232d86, 7a1ba621591a44129a55444eea0c9a2b, f52c10e78aa6423d9a44cd49ac3798c8; no voters:
I20260808 15:59:57.497928 14114 raft_consensus.cc:2781] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:59:57.498124 14114 raft_consensus.cc:686] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [term 1 LEADER]: Becoming Leader. State: Replica: f52c10e78aa6423d9a44cd49ac3798c8, State: Running, Role: LEADER
W20260808 15:59:57.498319 13664 tablet.cc:2369] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:59:57.498857 14114 consensus_queue.cc:237] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 15:59:57.501590 13365 catalog_manager.cc:5495] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3). New cstate: current_term: 1 leader_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } health_report { overall_health: UNKNOWN } } }
I20260808 15:59:57.522475 14100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.519504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54658 (local address 127.19.93.3:36355)
0808 15:59:57.519611 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 15:59:57.519614 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:59:57.519626 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:59:57.519788 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:59:57.519791 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:59:57.519841 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:59:57.519924 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:59:57.520124 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.520614 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.521347 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:59:57.521562 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:59:57.521632 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:59:57.521840 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:59:57.522194 (+ 354us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:59:57.522275 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 15:59:57.522302 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 15:59:57.522345 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 15:59:57.527701 13591 raft_consensus.cc:1261] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Refusing update from remote peer f52c10e78aa6423d9a44cd49ac3798c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:59:57.527707 13811 raft_consensus.cc:1261] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86 [term 1 FOLLOWER]: Refusing update from remote peer f52c10e78aa6423d9a44cd49ac3798c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:59:57.528324 14119 consensus_queue.cc:1035] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:59:57.528472 14114 consensus_queue.cc:1035] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:59:57.536957 14125 mvcc.cc:205] Tried to move back new op lower bound from 7316294850667425792 to 7316294850557550592. Current Snapshot: MvccSnapshot[applied={T|T < 7316294850667425792}]
I20260808 15:59:57.543078 13365 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:59:57.543206 13365 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:59:57.545241 13365 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Sending DeleteTablet for 3 replicas of tablet 949eaa07a8b24a46ba2ce014a7db2ab7
I20260808 15:59:57.545815 13563 tablet_service.cc:1514] Processing DeleteTablet for tablet 949eaa07a8b24a46ba2ce014a7db2ab7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:59:57 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:53782
I20260808 15:59:57.545852 13777 tablet_service.cc:1514] Processing DeleteTablet for tablet 949eaa07a8b24a46ba2ce014a7db2ab7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:59:57 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:53608
I20260808 15:59:57.546046 13983 tablet_service.cc:1514] Processing DeleteTablet for tablet 949eaa07a8b24a46ba2ce014a7db2ab7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:59:57 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:54654
I20260808 15:59:57.546238 14139 tablet_replica.cc:330] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86: stopping tablet replica
I20260808 15:59:57.546353 14138 tablet_replica.cc:330] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b: stopping tablet replica
I20260808 15:59:57.546492 14138 raft_consensus.cc:2229] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:59:57.546500 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 13422
I20260808 15:59:57.546523 14139 raft_consensus.cc:2229] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:59:57.546765 14139 raft_consensus.cc:2258] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:59:57.553810 14139 ts_tablet_manager.cc:1905] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:59:57.555224 14140 tablet_replica.cc:330] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8: stopping tablet replica
I20260808 15:59:57.555517 14140 raft_consensus.cc:2229] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:59:57.555859 14140 raft_consensus.cc:2258] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:59:57.556787 14139 ts_tablet_manager.cc:1918] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:59:57.556886 14139 log.cc:1196] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/949eaa07a8b24a46ba2ce014a7db2ab7
I20260808 15:59:57.557186 14139 ts_tablet_manager.cc:1939] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 16b20ddd655f4cc5b68a7fcb83232d86: Deleting consensus metadata
I20260808 15:59:57.558301 13343 catalog_manager.cc:4841] TS 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189): tablet 949eaa07a8b24a46ba2ce014a7db2ab7 (table test-table [id=0266be67b89f4ef1914d5e5ec255080e]) successfully deleted
I20260808 15:59:57.561162 14140 ts_tablet_manager.cc:1905] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 15:59:57.563277 13341 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:37751 (error 108)
I20260808 15:59:57.563704 14140 ts_tablet_manager.cc:1918] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:59:57.563756 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 13668
I20260808 15:59:57.563800 14140 log.cc:1196] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/949eaa07a8b24a46ba2ce014a7db2ab7
I20260808 15:59:57.564144 14140 ts_tablet_manager.cc:1939] T 949eaa07a8b24a46ba2ce014a7db2ab7 P f52c10e78aa6423d9a44cd49ac3798c8: Deleting consensus metadata
I20260808 15:59:57.564563 14102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:59:57.564253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:37751 (local address 127.0.0.1:53784)
0808 15:59:57.564380 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 15:59:57.564471 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:37751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 15:59:57.565526 13341 catalog_manager.cc:4584] TS 7a1ba621591a44129a55444eea0c9a2b (127.19.93.1:37751): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 949eaa07a8b24a46ba2ce014a7db2ab7: Network error: Client connection negotiation failed: client connection to 127.19.93.1:37751: connect: Connection refused (error 111)
I20260808 15:59:57.567369 13341 catalog_manager.cc:4841] TS f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3:36355): tablet 949eaa07a8b24a46ba2ce014a7db2ab7 (table test-table [id=0266be67b89f4ef1914d5e5ec255080e]) successfully deleted
I20260808 15:59:57.571744 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 13887
I20260808 15:59:57.578850 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 13316
I20260808 16:00:17.590308 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:46011
--webserver_interface=127.19.93.62
--webserver_port=45339
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:46011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:17.699553 14144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:17.699783 14144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:17.699819 14144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:17.703931 14144 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 16:00:17.703985 14144 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 16:00:17.704006 14144 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 16:00:17.704025 14144 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:17.704056 14144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:17.704095 14144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:17.704118 14144 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:17.704145 14144 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:17.709247 14144 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:46011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:46011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=45339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:17.710176 14144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:17.711133 14144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:17.719467 14156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:17.719430 14152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:17.719594 14154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:17.719622 14144 server_base.cc:1034] running on GCE node
I20260808 16:00:17.720321 14144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:17.721339 14144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:17.722505 14144 hybrid_clock.cc:648] HybridClock initialized: now 1786204817722485 us; error 32 us; skew 500 ppm
Aug 08 16:00:17 dist-test-slave-lgr5 krb5kdc[12495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204817, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:17.725112 14144 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 16:00:17.725942 14144 webserver.cc:460] Webserver started at http://127.19.93.62:45339/ using document root <none> and password file <none>
I20260808 16:00:17.726439 14144 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:17.726505 14144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:17.730101 14144 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:17.732169 14165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:17.733294 14144 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:00:17.733404 14144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "7383fc54fed2437fad56e7c5dc04056c"
format_stamp: "Formatted at 2026-08-08 15:59:35 on dist-test-slave-lgr5"
server_key: "53b165c79e46826b7796a6ace5618d0f"
server_key_iv: "59a10af757b533042c3d02c3a9ce00ec"
server_key_version: "encryptionkey@0"
I20260808 16:00:17.733901 14144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:17.747150 14144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:17.749675 14144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:17.749837 14144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:17.756402 14144 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:46011
I20260808 16:00:17.756664 14253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:46011 every 8 connection(s)
I20260808 16:00:17.757402 14144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:17.761464 14255 sys_catalog.cc:263] Verifying existing consensus state
I20260808 16:00:17.763037 14255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Bootstrap starting.
I20260808 16:00:17.766955 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 14144
I20260808 16:00:17.767443 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:37751
--local_ip_for_outbound_sockets=127.19.93.1
--tserver_master_addrs=127.19.93.62:46011
--webserver_port=41441
--webserver_interface=127.19.93.1
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 16:00:17.780575 14255 log.cc:824] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:17.791664 14255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 16:00:17.792016 14255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Bootstrap complete.
I20260808 16:00:17.795787 14255 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } }
I20260808 16:00:17.796195 14255 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7383fc54fed2437fad56e7c5dc04056c, State: Initialized, Role: FOLLOWER
I20260808 16:00:17.796676 14255 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } }
I20260808 16:00:17.796792 14255 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:17.796852 14255 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:17.796952 14255 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 2 FOLLOWER]: Advancing to term 3
I20260808 16:00:17.798697 14255 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } }
I20260808 16:00:17.799003 14255 leader_election.cc:302] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7383fc54fed2437fad56e7c5dc04056c; no voters:
I20260808 16:00:17.799276 14255 leader_election.cc:288] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 16:00:17.799409 14260 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 3 FOLLOWER]: Leader election won for term 3
I20260808 16:00:17.799661 14260 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [term 3 LEADER]: Becoming Leader. State: Replica: 7383fc54fed2437fad56e7c5dc04056c, State: Running, Role: LEADER
I20260808 16:00:17.799957 14260 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } }
I20260808 16:00:17.800442 14255 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:17.801313 14262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "7383fc54fed2437fad56e7c5dc04056c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } } }
I20260808 16:00:17.801452 14262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:17.801721 14263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7383fc54fed2437fad56e7c5dc04056c. Latest consensus state: current_term: 3 leader_uuid: "7383fc54fed2437fad56e7c5dc04056c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7383fc54fed2437fad56e7c5dc04056c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46011 } } }
I20260808 16:00:17.801864 14263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:17.802251 14275 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:17.807008 14275 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:17.807662 14275 catalog_manager.cc:1259] Loaded cluster ID: 70ebb446e82e465aa78a0b8bcd73ad82
I20260808 16:00:17.807723 14275 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:17.810343 14275 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:17.811065 14275 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Loaded TSK: 0
I20260808 16:00:17.811146 14275 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7383fc54fed2437fad56e7c5dc04056c: Loaded TSK: 1
F20260808 16:00:17.812425 14275 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fb46dda09ad google::LogMessage::Fail() at ??:0
@ 0x7fb46dda388a google::LogMessage::SendToLog() at ??:0
@ 0x7fb46dda04de google::LogMessage::Flush() at ??:0
@ 0x7fb46dda1a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fb470a6418d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fb470a5cf0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fb4787097bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fb4786e399c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fb4786e4178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7fb478725df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fb47874482b std::function<>::operator()() at ??:0
@ 0x7fb4786e3b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fb4786e4f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fb4786e1579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fb478725640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fb46fff23d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fb46fff2c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fb46fff43f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fb46ffe3512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fb4716276db start_thread at ??:0
@ 0x7fb46c89e61f clone at ??:0
W20260808 16:00:17.906988 14257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:17.907212 14257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:17.907253 14257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:17.911283 14257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:17.911336 14257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:17.911393 14257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 16:00:17.916550 14257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:37751
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=41441
--tserver_master_addrs=127.19.93.62:46011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:17.917574 14257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:17.918584 14257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:17.927877 14328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:17.927878 14329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:17.928172 14257 server_base.cc:1034] running on GCE node
W20260808 16:00:17.928377 14332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:17.928771 14257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:17.929381 14257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:17.930555 14257 hybrid_clock.cc:648] HybridClock initialized: now 1786204817930535 us; error 28 us; skew 500 ppm
Aug 08 16:00:17 dist-test-slave-lgr5 krb5kdc[12495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204817, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:17.933207 14257 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 16:00:17.934077 14257 webserver.cc:460] Webserver started at http://127.19.93.1:41441/ using document root <none> and password file <none>
I20260808 16:00:17.934607 14257 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:17.934674 14257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:17.938395 14257 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:17.940399 14344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:17.941574 14257 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:00:17.941668 14257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "7a1ba621591a44129a55444eea0c9a2b"
format_stamp: "Formatted at 2026-08-08 15:59:35 on dist-test-slave-lgr5"
server_key: "a3bf059355e4bc2397fa1bf109d9da24"
server_key_iv: "bf0ed66fb5888965ded188c5f1fcc9f5"
server_key_version: "encryptionkey@0"
I20260808 16:00:17.942169 14257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:17.952194 14257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:17.955041 14257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:17.955214 14257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:17.955765 14257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:17.956830 14355 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 16:00:17.960750 14257 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 16:00:17.960804 14257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260808 16:00:17.960848 14257 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 16:00:17.962451 14257 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 16:00:17.962504 14257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 16:00:17.962785 14355 tablet_bootstrap.cc:492] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b: Bootstrap starting.
I20260808 16:00:17.972433 14257 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:37751
I20260808 16:00:17.973738 14257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 16:00:17.975452 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 14257
I20260808 16:00:17.975904 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:40189
--local_ip_for_outbound_sockets=127.19.93.2
--tserver_master_addrs=127.19.93.62:46011
--webserver_port=37711
--webserver_interface=127.19.93.2
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 16:00:17.974644 14536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:37751 every 8 connection(s)
I20260808 16:00:17.987926 14355 log.cc:824] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:17.996630 14355 tablet_bootstrap.cc:492] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 16:00:17.997001 14355 tablet_bootstrap.cc:492] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b: Bootstrap complete.
I20260808 16:00:17.998317 14355 ts_tablet_manager.cc:1397] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b: Time spent bootstrapping tablet: real 0.036s user 0.026s sys 0.003s
I20260808 16:00:18.001441 14355 raft_consensus.cc:348] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 16:00:18.001986 14355 raft_consensus.cc:729] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1ba621591a44129a55444eea0c9a2b, State: Initialized, Role: FOLLOWER
I20260808 16:00:18.002511 14355 consensus_queue.cc:260] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 16:00:18.003566 14355 ts_tablet_manager.cc:1428] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260808 16:00:18.022548 14544 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:00:17.982782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:48123)
0808 16:00:17.983392 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:17.983451 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:17.984500 (+ 1049us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:18.021639 (+ 37139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":168,"threads_started":1}
W20260808 16:00:18.023061 14537 heartbeater.cc:644] Failed to heartbeat to 127.19.93.62:46011 (0 consecutive failures): Network error: Failed to ping master at 127.19.93.62:46011: Client connection negotiation failed: client connection to 127.19.93.62:46011: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 16:00:18.023809 14544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:18.023525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:57185)
0808 16:00:18.023666 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:18.023742 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 16:00:18.024524 14544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:18.024302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:33853)
0808 16:00:18.024412 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:18.024464 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 16:00:18.024695 14537 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 16:00:18.100023 14540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:18.100297 14540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:18.100338 14540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:18.104215 14540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:18.104264 14540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:18.104317 14540 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 16:00:18.109570 14540 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:40189
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=37711
--tserver_master_addrs=127.19.93.62:46011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:18.110491 14540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:18.111413 14540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:18.120389 14557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:18.120445 14558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:18.120426 14540 server_base.cc:1034] running on GCE node
W20260808 16:00:18.120395 14560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:18.120971 14540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:18.121558 14540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:18.122720 14540 hybrid_clock.cc:648] HybridClock initialized: now 1786204818122703 us; error 33 us; skew 500 ppm
Aug 08 16:00:18 dist-test-slave-lgr5 krb5kdc[12495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204818, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:18.125465 14540 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 16:00:18.126230 14540 webserver.cc:460] Webserver started at http://127.19.93.2:37711/ using document root <none> and password file <none>
I20260808 16:00:18.126721 14540 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:18.126777 14540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:18.130314 14540 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:18.132200 14569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:18.133307 14540 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:00:18.133416 14540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "16b20ddd655f4cc5b68a7fcb83232d86"
format_stamp: "Formatted at 2026-08-08 15:59:35 on dist-test-slave-lgr5"
server_key: "4a3fa8642b6d36a510c1156790e2f679"
server_key_iv: "5000db7e62ed742e1ec0110f6fd950f3"
server_key_version: "encryptionkey@0"
I20260808 16:00:18.133939 14540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:18.146366 14540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:18.148962 14540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:18.149122 14540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:18.149670 14540 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:18.150454 14540 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:18.150501 14540 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:18.150542 14540 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:18.150570 14540 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:18.158849 14540 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:40189
I20260808 16:00:18.158872 14751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:40189 every 8 connection(s)
I20260808 16:00:18.159768 14540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 16:00:18.163249 14755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:18.161678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:45475)
0808 16:00:18.162121 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:18.162589 (+ 468us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":109,"threads_started":1}
W20260808 16:00:18.163637 14752 heartbeater.cc:644] Failed to heartbeat to 127.19.93.62:46011 (0 consecutive failures): Network error: Failed to ping master at 127.19.93.62:46011: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
I20260808 16:00:18.164228 14755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:18.163979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:55845)
0808 16:00:18.164123 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:18.164175 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 16:00:18.164772 14755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:18.164595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:48903)
0808 16:00:18.164683 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:18.164724 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 16:00:18.164915 14752 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 16:00:18.168329 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 14540
I20260808 16:00:18.168720 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:36355
--local_ip_for_outbound_sockets=127.19.93.3
--tserver_master_addrs=127.19.93.62:46011
--webserver_port=43945
--webserver_interface=127.19.93.3
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:18.278389 14756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:18.278621 14756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:18.278661 14756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:18.282539 14756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:18.282589 14756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:18.282645 14756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 16:00:18.287607 14756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:36355
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=43945
--tserver_master_addrs=127.19.93.62:46011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:18.288559 14756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:18.289491 14756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:18.298483 14762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:18.298496 14761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:18.298532 14756 server_base.cc:1034] running on GCE node
W20260808 16:00:18.298496 14766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:18.299113 14756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:18.299706 14756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:18.300848 14756 hybrid_clock.cc:648] HybridClock initialized: now 1786204818300826 us; error 38 us; skew 500 ppm
Aug 08 16:00:18 dist-test-slave-lgr5 krb5kdc[12495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204818, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:18.303340 14756 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 16:00:18.304181 14756 webserver.cc:460] Webserver started at http://127.19.93.3:43945/ using document root <none> and password file <none>
I20260808 16:00:18.304710 14756 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:18.304775 14756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:18.308303 14756 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260808 16:00:18.310228 14773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:18.311339 14756 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:00:18.311443 14756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "f52c10e78aa6423d9a44cd49ac3798c8"
format_stamp: "Formatted at 2026-08-08 15:59:36 on dist-test-slave-lgr5"
server_key: "95f8a5cd45bd80a46b7962590f77955b"
server_key_iv: "a62af0645acbf642fc91c7f09e4115cf"
server_key_version: "encryptionkey@0"
I20260808 16:00:18.311937 14756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:18.326617 14756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:18.329455 14756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:18.329624 14756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:18.330153 14756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:18.330916 14756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:18.330963 14756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:18.331014 14756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:18.331043 14756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:18.339501 14756 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:36355
I20260808 16:00:18.339567 14965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:36355 every 8 connection(s)
I20260808 16:00:18.340468 14756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 16:00:18.344156 14968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:18.342402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:37325)
0808 16:00:18.342844 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:18.343375 (+ 531us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":116,"threads_started":1}
W20260808 16:00:18.344523 14966 heartbeater.cc:644] Failed to heartbeat to 127.19.93.62:46011 (0 consecutive failures): Network error: Failed to ping master at 127.19.93.62:46011: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
I20260808 16:00:18.345024 14968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:18.344841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:38041)
0808 16:00:18.344930 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:18.344972 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 16:00:18.345377 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 14756
I20260808 16:00:18.345711 14968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:18.345522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:54943)
0808 16:00:18.345619 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:18.345661 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 16:00:18.345862 14966 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 16:00:19.025621 14971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:19.025219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:57291)
0808 16:00:19.025466 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:19.025521 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":69,"threads_started":1}
I20260808 16:00:19.165738 14972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:19.165375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:40297)
0808 16:00:19.165594 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:19.165644 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":66,"threads_started":1}
I20260808 16:00:19.346661 14973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:19.346286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:46601)
0808 16:00:19.346503 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:19.346563 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":66,"threads_started":1}
I20260808 16:00:19.733035 14975 raft_consensus.cc:482] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 16:00:19.733223 14975 raft_consensus.cc:504] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 16:00:19.734231 14975 leader_election.cc:288] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3:36355), 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189)
Aug 08 16:00:19 dist-test-slave-lgr5 krb5kdc[12495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204817, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.2@KRBTEST.COM
Aug 08 16:00:19 dist-test-slave-lgr5 krb5kdc[12495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204817, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.3@KRBTEST.COM
I20260808 16:00:19.750793 14977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:19.734428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:40189 (local address 127.19.93.1:36189)
0808 16:00:19.734772 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:19.734787 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:19.734884 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:19.737169 (+ 2285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:19.737172 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:19.737383 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:19.738061 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:19.738074 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:19.739992 (+ 1918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:19.739996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:19.741567 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:19.741579 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:19.742531 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:19.742534 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:19.742780 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:19.743449 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:00:19.743477 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:19.745230 (+ 1753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:19.747788 (+ 2558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:19.747794 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:19.747808 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:19.748297 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:19.748748 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:19.748752 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:19.748754 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:19.748967 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:19.749712 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:19.749718 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:19.750058 (+ 340us) client_negotiation.cc:769] Sending connection context
0808 16:00:19.750260 (+ 202us) client_negotiation.cc:240] Negotiation successful
0808 16:00:19.750598 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"mutex_wait_us":276,"spinlock_wait_cycles":43776,"thread_start_us":62,"threads_started":1}
I20260808 16:00:19.750901 14980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:19.734615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:38945 (local address 127.19.93.3:36355)
0808 16:00:19.735091 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:19.735112 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:19.735152 (+ 40us) server_negotiation.cc:407] Connection header received
0808 16:00:19.736016 (+ 864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:19.736023 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:19.736484 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:19.736803 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:19.738253 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:19.739846 (+ 1593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:19.741705 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:19.742413 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:19.742584 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:19.745786 (+ 3202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:19.745792 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:19.745806 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:19.745839 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:19.747710 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:19.748449 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:19.748455 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:19.748461 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:19.748634 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:19.749071 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:19.749074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:19.749076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:19.749592 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:19.749724 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:19.750442 (+ 718us) server_negotiation.cc:299] Negotiation successful
0808 16:00:19.750710 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":132,"threads_started":1}
I20260808 16:00:19.750914 14981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:19.734738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:36189 (local address 127.19.93.2:40189)
0808 16:00:19.735091 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:19.735107 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:19.735152 (+ 45us) server_negotiation.cc:407] Connection header received
0808 16:00:19.736009 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:19.736018 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:19.736484 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:19.736803 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:19.738304 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:19.739846 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:19.741699 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:19.742432 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:19.742584 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:19.745482 (+ 2898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:19.745488 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:19.745504 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:19.745538 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:19.747658 (+ 2120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:19.748454 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:19.748459 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:19.748463 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:19.748634 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:19.749071 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:19.749074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:19.749076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:19.749592 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:19.749724 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:19.750424 (+ 700us) server_negotiation.cc:299] Negotiation successful
0808 16:00:19.750710 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":95,"threads_started":1}
I20260808 16:00:19.750797 14976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:19.734428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:36355 (local address 127.19.93.1:38945)
0808 16:00:19.734690 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:19.734704 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:19.734824 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:19.736857 (+ 2033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:19.736862 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:19.737383 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:19.738054 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:19.738074 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:19.739994 (+ 1920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:19.739996 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:19.741567 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:19.741579 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:19.742531 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:19.742534 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:19.742784 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:19.743480 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:00:19.743493 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:19.745582 (+ 2089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:19.747797 (+ 2215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:19.747800 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:19.747807 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:19.748297 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:19.748748 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:19.748752 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:19.748754 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:19.748967 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:19.749712 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:19.749718 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:19.750062 (+ 344us) client_negotiation.cc:769] Sending connection context
0808 16:00:19.750260 (+ 198us) client_negotiation.cc:240] Negotiation successful
0808 16:00:19.750664 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":430,"spinlock_wait_cycles":42880,"thread_start_us":78,"threads_started":1}
W20260808 16:00:19.753304 14349 leader_election.cc:341] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189): Not found: Tablet not found: 949eaa07a8b24a46ba2ce014a7db2ab7
W20260808 16:00:19.753432 14347 leader_election.cc:341] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3:36355): Not found: Tablet not found: 949eaa07a8b24a46ba2ce014a7db2ab7
I20260808 16:00:19.753535 14347 leader_election.cc:302] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a1ba621591a44129a55444eea0c9a2b; no voters: 16b20ddd655f4cc5b68a7fcb83232d86, f52c10e78aa6423d9a44cd49ac3798c8
I20260808 16:00:19.753785 14975 raft_consensus.cc:2726] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 16:00:20.026587 14976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:20.026315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:46891)
0808 16:00:20.026438 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:20.026492 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 16:00:20.166743 14982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:20.166363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:37577)
0808 16:00:20.166581 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:20.166632 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":72,"threads_started":1}
I20260808 16:00:20.347644 14984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:20.347270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:54927)
0808 16:00:20.347511 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:20.347560 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":73,"threads_started":1}
I20260808 16:00:21.027704 14985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:21.027288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:60697)
0808 16:00:21.027553 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:21.027606 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":85,"threads_started":1}
I20260808 16:00:21.167788 14988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:21.167426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:60607)
0808 16:00:21.167652 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:21.167703 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":70,"threads_started":1}
I20260808 16:00:21.348749 14991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:21.348321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:34979)
0808 16:00:21.348581 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:21.348660 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":74,"threads_started":1}
I20260808 16:00:21.603505 14992 raft_consensus.cc:482] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 16:00:21.603670 14992 raft_consensus.cc:504] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 16:00:21.604176 14992 leader_election.cc:288] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3:36355), 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189)
W20260808 16:00:21.604971 14349 leader_election.cc:341] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189): Not found: Tablet not found: 949eaa07a8b24a46ba2ce014a7db2ab7
W20260808 16:00:21.605079 14347 leader_election.cc:341] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3:36355): Not found: Tablet not found: 949eaa07a8b24a46ba2ce014a7db2ab7
I20260808 16:00:21.605178 14347 leader_election.cc:302] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a1ba621591a44129a55444eea0c9a2b; no voters: 16b20ddd655f4cc5b68a7fcb83232d86, f52c10e78aa6423d9a44cd49ac3798c8
I20260808 16:00:21.605350 14992 raft_consensus.cc:2726] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 16:00:22.028895 14993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:22.028445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:41041)
0808 16:00:22.028742 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:22.028793 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":101,"threads_started":1}
I20260808 16:00:22.168841 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:22.168454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:54217)
0808 16:00:22.168700 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:22.168750 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":87,"threads_started":1}
I20260808 16:00:22.349814 14999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:22.349406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:48555)
0808 16:00:22.349676 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:22.349728 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":90,"threads_started":1}
I20260808 16:00:23.030153 15000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:23.029692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:38271)
0808 16:00:23.029999 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:23.030057 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":72,"threads_started":1}
I20260808 16:00:23.169921 15003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:23.169505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:50057)
0808 16:00:23.169771 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:23.169825 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":93,"threads_started":1}
I20260808 16:00:23.350893 15004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:23.350465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:60339)
0808 16:00:23.350744 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:23.350800 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":94,"threads_started":1}
I20260808 16:00:24.031213 15006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:24.030810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:33971)
0808 16:00:24.031062 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:24.031116 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":92,"threads_started":1}
I20260808 16:00:24.117208 15009 raft_consensus.cc:482] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 16:00:24.117337 15009 raft_consensus.cc:504] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 16:00:24.117702 15009 leader_election.cc:288] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3:36355), 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189)
W20260808 16:00:24.118443 14347 leader_election.cc:341] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3:36355): Not found: Tablet not found: 949eaa07a8b24a46ba2ce014a7db2ab7
W20260808 16:00:24.118556 14349 leader_election.cc:341] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189): Not found: Tablet not found: 949eaa07a8b24a46ba2ce014a7db2ab7
I20260808 16:00:24.118618 14349 leader_election.cc:302] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a1ba621591a44129a55444eea0c9a2b; no voters: 16b20ddd655f4cc5b68a7fcb83232d86, f52c10e78aa6423d9a44cd49ac3798c8
I20260808 16:00:24.118745 15009 raft_consensus.cc:2726] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 16:00:24.170953 15010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:24.170518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:35033)
0808 16:00:24.170806 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:24.170862 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":62,"threads_started":1}
I20260808 16:00:24.352006 15015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:24.351634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:53901)
0808 16:00:24.351863 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:24.351916 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":72,"threads_started":1}
I20260808 16:00:25.032389 15016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:25.031918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:35547)
0808 16:00:25.032213 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:25.032289 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":84,"threads_started":1}
I20260808 16:00:25.172034 15018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:25.171614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:41987)
0808 16:00:25.171889 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:25.171942 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":72,"threads_started":1}
I20260808 16:00:25.353111 15019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:25.352680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:60483)
0808 16:00:25.352966 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:25.353020 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":86,"threads_started":1}
I20260808 16:00:26.033517 15024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:26.033077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:57693)
0808 16:00:26.033359 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:26.033418 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":87,"threads_started":1}
I20260808 16:00:26.173170 15026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:26.172759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:49307)
0808 16:00:26.173008 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:26.173076 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":81,"threads_started":1}
I20260808 16:00:26.354139 15027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:26.353750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:44767)
0808 16:00:26.353995 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:26.354049 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":73,"threads_started":1}
I20260808 16:00:26.657130 15028 raft_consensus.cc:482] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 16:00:26.657263 15028 raft_consensus.cc:504] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 16:00:26.657672 15028 leader_election.cc:288] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3:36355), 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189)
W20260808 16:00:26.658437 14347 leader_election.cc:341] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3:36355): Not found: Tablet not found: 949eaa07a8b24a46ba2ce014a7db2ab7
W20260808 16:00:26.658557 14349 leader_election.cc:341] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189): Not found: Tablet not found: 949eaa07a8b24a46ba2ce014a7db2ab7
I20260808 16:00:26.658658 14349 leader_election.cc:302] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a1ba621591a44129a55444eea0c9a2b; no voters: 16b20ddd655f4cc5b68a7fcb83232d86, f52c10e78aa6423d9a44cd49ac3798c8
I20260808 16:00:26.658815 15028 raft_consensus.cc:2726] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 16:00:27.034693 15029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:27.034285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:47199)
0808 16:00:27.034542 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:27.034595 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":92,"threads_started":1}
I20260808 16:00:27.174183 15030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:27.173798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:46025)
0808 16:00:27.174038 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:27.174092 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":74,"threads_started":1}
I20260808 16:00:27.355204 15032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:27.354801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:46211)
0808 16:00:27.355052 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:27.355116 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":81,"threads_started":1}
I20260808 16:00:28.035934 15033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:28.035549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:50827)
0808 16:00:28.035781 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:28.035835 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":79,"threads_started":1}
I20260808 16:00:28.175252 15035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:28.174866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:47685)
0808 16:00:28.175106 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:28.175158 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":72,"threads_started":1}
I20260808 16:00:28.356304 15036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:28.355896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:55153)
0808 16:00:28.356158 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:28.356211 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":70,"threads_started":1}
I20260808 16:00:29.037017 15038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:29.036629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:55915)
0808 16:00:29.036866 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:29.036915 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":83,"threads_started":1}
I20260808 16:00:29.176448 15039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:29.175942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:42409)
0808 16:00:29.176218 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:29.176285 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":62,"threads_started":1}
I20260808 16:00:29.357419 15040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:29.357008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:40677)
0808 16:00:29.357267 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:29.357321 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":81,"threads_started":1}
I20260808 16:00:30.038151 15041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:30.037753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:47205)
0808 16:00:30.037993 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:30.038051 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":76,"threads_started":1}
I20260808 16:00:30.177524 15042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:30.177165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:32835)
0808 16:00:30.177382 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:30.177431 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":71,"threads_started":1}
I20260808 16:00:30.358513 15043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:30.358130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:36315)
0808 16:00:30.358369 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:30.358422 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":76,"threads_started":1}
I20260808 16:00:31.039215 15044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:31.038808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:41579)
0808 16:00:31.039060 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:31.039115 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":74,"threads_started":1}
I20260808 16:00:31.178603 15046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:31.178209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:56017)
0808 16:00:31.178437 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:31.178490 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":76,"threads_started":1}
I20260808 16:00:31.359566 15047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:31.359175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:44065)
0808 16:00:31.359420 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:31.359474 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":72,"threads_started":1}
I20260808 16:00:32.040302 15048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:32.039888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:45109)
0808 16:00:32.040150 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:32.040204 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":73,"threads_started":1}
I20260808 16:00:32.179719 15049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:32.179319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:46731)
0808 16:00:32.179567 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:32.179621 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":79,"threads_started":1}
I20260808 16:00:32.360669 15051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:32.360253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:52535)
0808 16:00:32.360515 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:32.360573 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":93,"threads_started":1}
I20260808 16:00:32.562661 15053 raft_consensus.cc:482] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 16:00:32.562798 15053 raft_consensus.cc:504] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f52c10e78aa6423d9a44cd49ac3798c8" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 36355 } } peers { permanent_uuid: "16b20ddd655f4cc5b68a7fcb83232d86" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40189 } } peers { permanent_uuid: "7a1ba621591a44129a55444eea0c9a2b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37751 } }
I20260808 16:00:32.563164 15053 leader_election.cc:288] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3:36355), 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189)
W20260808 16:00:32.563885 14347 leader_election.cc:341] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f52c10e78aa6423d9a44cd49ac3798c8 (127.19.93.3:36355): Not found: Tablet not found: 949eaa07a8b24a46ba2ce014a7db2ab7
W20260808 16:00:32.563992 14349 leader_election.cc:341] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 16b20ddd655f4cc5b68a7fcb83232d86 (127.19.93.2:40189): Not found: Tablet not found: 949eaa07a8b24a46ba2ce014a7db2ab7
I20260808 16:00:32.564101 14349 leader_election.cc:302] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a1ba621591a44129a55444eea0c9a2b; no voters: 16b20ddd655f4cc5b68a7fcb83232d86, f52c10e78aa6423d9a44cd49ac3798c8
I20260808 16:00:32.564236 15053 raft_consensus.cc:2726] T 949eaa07a8b24a46ba2ce014a7db2ab7 P 7a1ba621591a44129a55444eea0c9a2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 16:00:33.041553 15054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:33.041173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.1:60693)
0808 16:00:33.041397 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:33.041447 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":77,"threads_started":1}
I20260808 16:00:33.180895 15055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:33.180524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.2:57529)
0808 16:00:33.180754 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:33.180806 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":72,"threads_started":1}
I20260808 16:00:33.353729 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 14257
I20260808 16:00:33.362836 15056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:33.362440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:46011 (local address 127.19.93.3:51657)
0808 16:00:33.362689 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:33.362744 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.62:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":64,"threads_started":1}
I20260808 16:00:33.367738 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 14540
I20260808 16:00:33.377556 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 14756
2026-08-08T16:00:33Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59327 ms)
[----------] 30 tests from SecurityITest (237754 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:00:33 dist-test-slave-lgr5 krb5kdc[15059](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:00:33 dist-test-slave-lgr5 krb5kdc[15059](info): set up 2 sockets
Aug 08 16:00:33 dist-test-slave-lgr5 krb5kdc[15059](info): commencing operation
krb5kdc: starting...
W20260808 16:00:34.536439 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:00:34 dist-test-slave-lgr5 krb5kdc[15059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:00:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:00:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 16:00:34.651010 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:44509
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:44509
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:34.756597 15081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:34.756832 15081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:34.756873 15081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:34.760661 15081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:34.760707 15081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:34.760728 15081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:34.760751 15081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:34.760773 15081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:34.765977 15081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:44509
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:44509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:34.766845 15081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:34.767733 15081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 16:00:34.776264 15081 server_base.cc:1034] running on GCE node
W20260808 16:00:34.776242 15088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:34.776216 15093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:34.776216 15091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:34.777199 15081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:34.778290 15081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:34.779474 15081 hybrid_clock.cc:648] HybridClock initialized: now 1786204834779451 us; error 35 us; skew 500 ppm
Aug 08 16:00:34 dist-test-slave-lgr5 krb5kdc[15059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204834, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:34.782171 15081 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 16:00:34.782955 15081 webserver.cc:460] Webserver started at http://127.19.93.62:37691/ using document root <none> and password file <none>
I20260808 16:00:34.783456 15081 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:34.783514 15081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:34.783670 15081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:34.785665 15081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "a1480b046af545dbbc6b42537c8a8c09"
format_stamp: "Formatted at 2026-08-08 16:00:34 on dist-test-slave-lgr5"
server_key: "6c1ab2d848d40177d7b8e199d4c5ad14"
server_key_iv: "9bd131807ca222b6ba96ca2e8285f92f"
server_key_version: "encryptionkey@0"
I20260808 16:00:34.786175 15081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "a1480b046af545dbbc6b42537c8a8c09"
format_stamp: "Formatted at 2026-08-08 16:00:34 on dist-test-slave-lgr5"
server_key: "6c1ab2d848d40177d7b8e199d4c5ad14"
server_key_iv: "9bd131807ca222b6ba96ca2e8285f92f"
server_key_version: "encryptionkey@0"
I20260808 16:00:34.789624 15081 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 16:00:34.791807 15104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:34.792929 15081 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:00:34.793046 15081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "a1480b046af545dbbc6b42537c8a8c09"
format_stamp: "Formatted at 2026-08-08 16:00:34 on dist-test-slave-lgr5"
server_key: "6c1ab2d848d40177d7b8e199d4c5ad14"
server_key_iv: "9bd131807ca222b6ba96ca2e8285f92f"
server_key_version: "encryptionkey@0"
I20260808 16:00:34.793141 15081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:34.809567 15081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:34.812264 15081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:34.812413 15081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:34.818789 15081 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:44509
I20260808 16:00:34.818887 15198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:44509 every 8 connection(s)
I20260808 16:00:34.819731 15081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:34.822496 15199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:34.826128 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 15081
I20260808 16:00:34.826234 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:00:34.826498 19828 external_mini_cluster.cc:1428] Setting key 463098f262fe2b5dfd92cbb3feef873e
I20260808 16:00:34.828477 15199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09: Bootstrap starting.
I20260808 16:00:34.831173 15199 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:34.832046 15199 log.cc:824] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:34.834165 15199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09: No bootstrap required, opened a new log
Aug 08 16:00:34 dist-test-slave-lgr5 krb5kdc[15059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:00:34.837962 15199 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1480b046af545dbbc6b42537c8a8c09" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44509 } }
I20260808 16:00:34.838171 15199 raft_consensus.cc:374] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:34.838205 15199 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1480b046af545dbbc6b42537c8a8c09, State: Initialized, Role: FOLLOWER
I20260808 16:00:34.838620 15199 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1480b046af545dbbc6b42537c8a8c09" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44509 } }
I20260808 16:00:34.838743 15199 raft_consensus.cc:388] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:34.838830 15199 raft_consensus.cc:482] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:34.838924 15199 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:34.839754 15199 raft_consensus.cc:504] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1480b046af545dbbc6b42537c8a8c09" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44509 } }
I20260808 16:00:34.840068 15199 leader_election.cc:302] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1480b046af545dbbc6b42537c8a8c09; no voters:
I20260808 16:00:34.840418 15199 leader_election.cc:288] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:00:34.840503 15205 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:34.840736 15205 raft_consensus.cc:686] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [term 1 LEADER]: Becoming Leader. State: Replica: a1480b046af545dbbc6b42537c8a8c09, State: Running, Role: LEADER
I20260808 16:00:34.841130 15205 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1480b046af545dbbc6b42537c8a8c09" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44509 } }
I20260808 16:00:34.841560 15203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:34.827911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32958 (local address 127.19.93.62:44509)
0808 16:00:34.828395 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:34.828415 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:34.828459 (+ 44us) server_negotiation.cc:407] Connection header received
0808 16:00:34.829272 (+ 813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:34.829296 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:34.829708 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:34.830079 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:34.830724 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:34.832226 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:34.833047 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:34.833721 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:34.833889 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:34.836401 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:34.836406 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:34.836425 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:34.836459 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:34.838220 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:34.838708 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:34.838716 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:34.838723 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:34.838900 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:34.839209 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:34.839213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:34.839215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:34.839639 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:34.839848 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:34.840201 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 16:00:34.840548 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":184,"threads_started":1}
I20260808 16:00:34.841619 15199 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:34.843565 15209 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1480b046af545dbbc6b42537c8a8c09. Latest consensus state: current_term: 1 leader_uuid: "a1480b046af545dbbc6b42537c8a8c09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1480b046af545dbbc6b42537c8a8c09" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44509 } } }
I20260808 16:00:34.843676 15207 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1480b046af545dbbc6b42537c8a8c09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1480b046af545dbbc6b42537c8a8c09" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44509 } } }
I20260808 16:00:34.844357 15209 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:34.844357 15207 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09 [sys.catalog]: This master's current role is: LEADER
W20260808 16:00:34.846108 15227 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 16:00:34.846174 15227 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 16:00:34.846254 15229 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:34.846935 15229 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:34.851693 15229 catalog_manager.cc:1347] Generated new cluster ID: c9e974a7d75d4e599d359890e2ef90aa
I20260808 16:00:34.851759 15229 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:34.865585 15229 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:00:34.866434 15229 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:34.874462 15229 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09: Generated new TSK 0
I20260808 16:00:34.875111 15229 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 16:00:34.902968 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44509
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:35.012492 15237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:35.012734 15237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:35.012776 15237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:35.016641 15237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:35.016685 15237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:35.016737 15237 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 16:00:35.021718 15237 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15237
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:35.022624 15237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:35.023538 15237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:35.032636 15247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:35.032752 15237 server_base.cc:1034] running on GCE node
W20260808 16:00:35.032636 15244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:35.032892 15245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:35.033298 15237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:35.033887 15237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:35.035068 15237 hybrid_clock.cc:648] HybridClock initialized: now 1786204835035044 us; error 25 us; skew 500 ppm
Aug 08 16:00:35 dist-test-slave-lgr5 krb5kdc[15059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204835, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:35.037681 15237 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 16:00:35.038504 15237 webserver.cc:460] Webserver started at http://127.19.93.1:40809/ using document root <none> and password file <none>
I20260808 16:00:35.039048 15237 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:35.039115 15237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:35.039331 15237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:35.041344 15237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "0407f5bd1ae74ceaa6ef0a7dc37631b0"
format_stamp: "Formatted at 2026-08-08 16:00:35 on dist-test-slave-lgr5"
server_key: "f55e0fae482a420c559701275782d4a0"
server_key_iv: "dd9e8d75336ed255876612d005e3f5bb"
server_key_version: "encryptionkey@0"
I20260808 16:00:35.041898 15237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "0407f5bd1ae74ceaa6ef0a7dc37631b0"
format_stamp: "Formatted at 2026-08-08 16:00:35 on dist-test-slave-lgr5"
server_key: "f55e0fae482a420c559701275782d4a0"
server_key_iv: "dd9e8d75336ed255876612d005e3f5bb"
server_key_version: "encryptionkey@0"
I20260808 16:00:35.045482 15237 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 16:00:35.047652 15259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:35.048756 15237 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:00:35.048864 15237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "0407f5bd1ae74ceaa6ef0a7dc37631b0"
format_stamp: "Formatted at 2026-08-08 16:00:35 on dist-test-slave-lgr5"
server_key: "f55e0fae482a420c559701275782d4a0"
server_key_iv: "dd9e8d75336ed255876612d005e3f5bb"
server_key_version: "encryptionkey@0"
I20260808 16:00:35.048954 15237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:35.062450 15237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:35.065212 15237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:35.065375 15237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:35.065904 15237 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:35.066665 15237 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:35.066713 15237 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:35.066763 15237 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:35.066789 15237 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:35.074921 15237 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:38595
I20260808 16:00:35.074958 15433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:38595 every 8 connection(s)
I20260808 16:00:35.075730 15237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 16:00:35.078824 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 15237
I20260808 16:00:35.078946 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 16:00:35.079257 19828 external_mini_cluster.cc:1428] Setting key df742584620068267fbd2b0d7da8fe8a
Aug 08 16:00:35 dist-test-slave-lgr5 krb5kdc[15059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204835, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:00:35.089367 15203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.077305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:58249 (local address 127.19.93.62:44509)
0808 16:00:35.077419 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:35.077423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:35.078211 (+ 788us) server_negotiation.cc:407] Connection header received
0808 16:00:35.079658 (+ 1447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:35.079662 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:35.079725 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:35.079816 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:35.081142 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.081713 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.083151 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.083398 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.083487 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.085745 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:35.085750 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:35.085752 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:35.085783 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:35.087220 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:35.087806 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:35.087808 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:35.087809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:35.087886 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:35.088300 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:35.088302 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:35.088303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:35.088492 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:35.088569 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:35.089140 (+ 571us) server_negotiation.cc:299] Negotiation successful
0808 16:00:35.089240 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
I20260808 16:00:35.090353 15437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.077613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44509 (local address 127.19.93.1:58249)
0808 16:00:35.078069 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:35.078108 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:35.079435 (+ 1327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:35.080023 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:35.080030 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:35.080381 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:35.080970 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:35.080990 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.081862 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.081865 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:35.083033 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:35.083044 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.083538 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.083542 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:35.083707 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.084232 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:00:35.084248 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:35.085582 (+ 1334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:35.087336 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:35.087342 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:35.087357 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:35.087712 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:35.087968 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:35.087972 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:35.087974 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:35.088206 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:35.088588 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:35.088594 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:35.088894 (+ 300us) client_negotiation.cc:769] Sending connection context
0808 16:00:35.089101 (+ 207us) client_negotiation.cc:240] Negotiation successful
0808 16:00:35.089444 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":112,"threads_started":1}
I20260808 16:00:35.091475 15435 heartbeater.cc:347] Connected to a master server at 127.19.93.62:44509
I20260808 16:00:35.091714 15435 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:35.092228 15435 heartbeater.cc:511] Master 127.19.93.62:44509 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
I20260808 16:00:35.093706 15137 ts_manager.cc:194] Registered new tserver with Master: 0407f5bd1ae74ceaa6ef0a7dc37631b0 (127.19.93.1:38595)
I20260808 16:00:35.095253 15137 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:58249
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 16:00:35.106519 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44509
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:35.214536 15442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:35.214766 15442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:35.214805 15442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:35.218734 15442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:35.218781 15442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:35.218842 15442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 16:00:35.223780 15442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:35.224694 15442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:35.225617 15442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:35.234481 15454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:35.234560 15450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:35.234545 15452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:35.234676 15442 server_base.cc:1034] running on GCE node
I20260808 16:00:35.235018 15442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:35.235597 15442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:35.236752 15442 hybrid_clock.cc:648] HybridClock initialized: now 1786204835236737 us; error 25 us; skew 500 ppm
Aug 08 16:00:35 dist-test-slave-lgr5 krb5kdc[15059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204835, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:35.239199 15442 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 16:00:35.240005 15442 webserver.cc:460] Webserver started at http://127.19.93.2:46781/ using document root <none> and password file <none>
I20260808 16:00:35.240523 15442 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:35.240599 15442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:35.240795 15442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:35.242997 15442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "422e93b0fdde40d1980d20a447b1360f"
format_stamp: "Formatted at 2026-08-08 16:00:35 on dist-test-slave-lgr5"
server_key: "a440048ef8729271c274532d3e0727f7"
server_key_iv: "43cca8c7a0c7c7ddd24f21df0e507c20"
server_key_version: "encryptionkey@0"
I20260808 16:00:35.243561 15442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "422e93b0fdde40d1980d20a447b1360f"
format_stamp: "Formatted at 2026-08-08 16:00:35 on dist-test-slave-lgr5"
server_key: "a440048ef8729271c274532d3e0727f7"
server_key_iv: "43cca8c7a0c7c7ddd24f21df0e507c20"
server_key_version: "encryptionkey@0"
I20260808 16:00:35.247002 15442 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 16:00:35.249269 15465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:35.250335 15442 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 16:00:35.250470 15442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "422e93b0fdde40d1980d20a447b1360f"
format_stamp: "Formatted at 2026-08-08 16:00:35 on dist-test-slave-lgr5"
server_key: "a440048ef8729271c274532d3e0727f7"
server_key_iv: "43cca8c7a0c7c7ddd24f21df0e507c20"
server_key_version: "encryptionkey@0"
I20260808 16:00:35.250558 15442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:35.263062 15442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:35.265594 15442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:35.265730 15442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:35.266208 15442 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:35.266932 15442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:35.266975 15442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:35.267010 15442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:35.267030 15442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:35.275343 15442 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:45623
I20260808 16:00:35.275369 15644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:45623 every 8 connection(s)
I20260808 16:00:35.276165 15442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 16:00:35.281806 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 15442
I20260808 16:00:35.281967 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 16:00:35.282291 19828 external_mini_cluster.cc:1428] Setting key 8e6a2ea4d258b85be85e7907142d0ddd
Aug 08 16:00:35 dist-test-slave-lgr5 krb5kdc[15059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204835, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:00:35.288720 15203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.277745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:59929 (local address 127.19.93.62:44509)
0808 16:00:35.277908 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:35.277913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:35.278656 (+ 743us) server_negotiation.cc:407] Connection header received
0808 16:00:35.279798 (+ 1142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:35.279801 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:35.279849 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:35.279939 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:35.280959 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.281485 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.282934 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.283177 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.283274 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.285578 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:35.285582 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:35.285584 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:35.285607 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:35.286816 (+ 1209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:35.287277 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:35.287280 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:35.287282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:35.287359 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:35.287670 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:35.287673 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:35.287675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:35.287845 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:35.287928 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:35.288440 (+ 512us) server_negotiation.cc:299] Negotiation successful
0808 16:00:35.288565 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 16:00:35.289415 15652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.278080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44509 (local address 127.19.93.2:59929)
0808 16:00:35.278505 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:35.278543 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:35.279620 (+ 1077us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:35.280070 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:35.280089 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:35.280412 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:35.280832 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:35.280844 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.281601 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.281605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:35.282819 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:35.282831 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.283323 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.283328 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:35.283504 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.284068 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:00:35.284107 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:35.285426 (+ 1319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:35.286923 (+ 1497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:35.286929 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:35.286942 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:35.287182 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:35.287443 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:35.287446 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:35.287448 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:35.287583 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:35.287945 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:35.287951 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:35.288224 (+ 273us) client_negotiation.cc:769] Sending connection context
0808 16:00:35.288381 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 16:00:35.288684 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":108,"threads_started":1}
I20260808 16:00:35.290470 15645 heartbeater.cc:347] Connected to a master server at 127.19.93.62:44509
I20260808 16:00:35.290704 15645 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:35.291244 15645 heartbeater.cc:511] Master 127.19.93.62:44509 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
I20260808 16:00:35.292356 15137 ts_manager.cc:194] Registered new tserver with Master: 422e93b0fdde40d1980d20a447b1360f (127.19.93.2:45623)
I20260808 16:00:35.292936 15137 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:59929
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 16:00:35.308418 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44509
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:35.417060 15661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:35.417272 15661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:35.417313 15661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:35.421267 15661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:35.421316 15661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:35.421387 15661 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 16:00:35.426348 15661 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:35.427241 15661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:35.428254 15661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:35.437186 15673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:35.437178 15671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:35.437178 15668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:35.437227 15661 server_base.cc:1034] running on GCE node
I20260808 16:00:35.437768 15661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:35.438308 15661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:35.439461 15661 hybrid_clock.cc:648] HybridClock initialized: now 1786204835439436 us; error 36 us; skew 500 ppm
Aug 08 16:00:35 dist-test-slave-lgr5 krb5kdc[15059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204835, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:35.442086 15661 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 16:00:35.442929 15661 webserver.cc:460] Webserver started at http://127.19.93.3:44805/ using document root <none> and password file <none>
I20260808 16:00:35.443449 15661 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:35.443512 15661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:35.443701 15661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:35.445698 15661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "0ab1627a7dca440592162f22cb71da46"
format_stamp: "Formatted at 2026-08-08 16:00:35 on dist-test-slave-lgr5"
server_key: "0cd13cfab7a2ac54930d51245702f7fa"
server_key_iv: "a2087be3db33ec438ee850bac8a59eca"
server_key_version: "encryptionkey@0"
I20260808 16:00:35.446204 15661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "0ab1627a7dca440592162f22cb71da46"
format_stamp: "Formatted at 2026-08-08 16:00:35 on dist-test-slave-lgr5"
server_key: "0cd13cfab7a2ac54930d51245702f7fa"
server_key_iv: "a2087be3db33ec438ee850bac8a59eca"
server_key_version: "encryptionkey@0"
I20260808 16:00:35.449568 15661 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 16:00:35.451722 15684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:35.452901 15661 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:35.453025 15661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "0ab1627a7dca440592162f22cb71da46"
format_stamp: "Formatted at 2026-08-08 16:00:35 on dist-test-slave-lgr5"
server_key: "0cd13cfab7a2ac54930d51245702f7fa"
server_key_iv: "a2087be3db33ec438ee850bac8a59eca"
server_key_version: "encryptionkey@0"
I20260808 16:00:35.453147 15661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:35.471838 15661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:35.474475 15661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:35.474630 15661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:35.475180 15661 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:35.475932 15661 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:35.475977 15661 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:35.476015 15661 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:35.476051 15661 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:35.484324 15661 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:45637
I20260808 16:00:35.484350 15884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:45637 every 8 connection(s)
I20260808 16:00:35.485149 15661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 16:00:35.493904 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 15661
I20260808 16:00:35.494035 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
Aug 08 16:00:35 dist-test-slave-lgr5 krb5kdc[15059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204835, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:00:35.494306 19828 external_mini_cluster.cc:1428] Setting key 26fb16d09d88867eb9277b0e7d28ddd0
I20260808 16:00:35.498315 15203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.486825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:38727 (local address 127.19.93.62:44509)
0808 16:00:35.486974 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:35.486977 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:35.488239 (+ 1262us) server_negotiation.cc:407] Connection header received
0808 16:00:35.489143 (+ 904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:35.489147 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:35.489207 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:35.489281 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:35.490442 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.490981 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.492116 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.492333 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.492423 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.494859 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:35.494863 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:35.494865 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:35.494896 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:35.496397 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:35.496874 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:35.496877 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:35.496879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:35.496982 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:35.497277 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:35.497279 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:35.497280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:35.497458 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:35.497546 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:35.498036 (+ 490us) server_negotiation.cc:299] Negotiation successful
0808 16:00:35.498159 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 16:00:35.499047 15889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.487160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44509 (local address 127.19.93.3:38727)
0808 16:00:35.488044 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:35.488115 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:35.488928 (+ 813us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:35.489486 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:35.489492 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:35.489827 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:35.490285 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:35.490299 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.491101 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.491104 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:35.491972 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:35.491982 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.492484 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.492488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:35.492646 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.493199 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:00:35.493214 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:35.494678 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:35.496504 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:35.496510 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:35.496523 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:35.496794 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:35.497075 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:35.497077 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:35.497079 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:35.497206 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:35.497569 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:35.497575 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:35.497805 (+ 230us) client_negotiation.cc:769] Sending connection context
0808 16:00:35.497976 (+ 171us) client_negotiation.cc:240] Negotiation successful
0808 16:00:35.498282 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":693,"thread_start_us":522,"threads_started":1}
I20260808 16:00:35.500008 15885 heartbeater.cc:347] Connected to a master server at 127.19.93.62:44509
I20260808 16:00:35.500240 15885 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:35.500697 15885 heartbeater.cc:511] Master 127.19.93.62:44509 requested a full tablet report, sending...
I20260808 16:00:35.501616 15137 ts_manager.cc:194] Registered new tserver with Master: 0ab1627a7dca440592162f22cb71da46 (127.19.93.3:45637)
I20260808 16:00:35.502146 15137 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:38727
I20260808 16:00:35.507961 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 16:00:35.516191 15203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.509792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32968 (local address 127.19.93.62:44509)
0808 16:00:35.509914 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:35.509918 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:35.510100 (+ 182us) server_negotiation.cc:407] Connection header received
0808 16:00:35.510206 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:35.510210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:35.510248 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:35.510308 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:35.510943 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.511412 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.512232 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.512439 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.512524 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.513677 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:35.513680 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:35.513682 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:35.513703 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:35.514693 (+ 990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:35.515073 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:35.515076 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:35.515078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:35.515148 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:35.515387 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:35.515391 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:35.515393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:35.515585 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:35.515704 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:35.515932 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 16:00:35.516031 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 16:00:35.518642 15137 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32968:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 16:00:35.521533 15137 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 16:00:35.535296 15910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.529273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:45623 (local address 127.0.0.1:37434)
0808 16:00:35.529898 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:35.529947 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:35.530063 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:35.530803 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:35.530809 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:35.530833 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:35.530953 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:35.530960 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.532399 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.532403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:35.533768 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:35.533781 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.534825 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.534828 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:35.534906 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.534942 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 16:00:35.535031 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 16:00:35.535160 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":55,"thread_start_us":76,"threads_started":1}
I20260808 16:00:35.535324 15913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.529427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37434 (local address 127.19.93.2:45623)
0808 16:00:35.530352 (+ 925us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:35.530361 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:35.530389 (+ 28us) server_negotiation.cc:407] Connection header received
0808 16:00:35.530450 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:35.530454 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:35.530635 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:35.531090 (+ 455us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:35.531242 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.532274 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.533904 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.534720 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.534829 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.534970 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:35.535106 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 16:00:35.535197 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":826,"thread_start_us":115,"threads_started":1}
I20260808 16:00:35.535831 15912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.529613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:38595 (local address 127.0.0.1:36376)
0808 16:00:35.530618 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:35.530630 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:35.530724 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:35.531339 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:35.531342 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:35.531361 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:35.531456 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:35.531462 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.532737 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.532741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:35.533795 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:35.533806 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.535463 (+ 1657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.535466 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:35.535547 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.535570 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 16:00:35.535638 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 16:00:35.535706 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":949,"mutex_wait_us":42,"thread_start_us":90,"threads_started":1}
I20260808 16:00:35.536175 15915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.529361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:45637 (local address 127.0.0.1:53710)
0808 16:00:35.530127 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:35.530139 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:35.530212 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:35.531064 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:35.531067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:35.531086 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:35.531170 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:35.531176 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.532259 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.532262 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:35.533794 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:35.533801 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.535776 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.535780 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:35.535862 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.535884 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 16:00:35.535966 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 16:00:35.536035 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":712,"mutex_wait_us":132,"thread_start_us":87,"threads_started":1}
I20260808 16:00:35.536319 15920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.530119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36376 (local address 127.19.93.1:38595)
0808 16:00:35.530469 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:35.530483 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:35.530814 (+ 331us) server_negotiation.cc:407] Connection header received
0808 16:00:35.530886 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:35.530890 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:35.531054 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:35.531180 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:35.531612 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.532616 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.533928 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.534720 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.534829 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.534970 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:35.536049 (+ 1079us) server_negotiation.cc:299] Negotiation successful
0808 16:00:35.536186 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":90,"threads_started":1}
I20260808 16:00:35.536437 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.530025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53710 (local address 127.19.93.3:45637)
0808 16:00:35.530644 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:35.530656 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:35.530676 (+ 20us) server_negotiation.cc:407] Connection header received
0808 16:00:35.530741 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:35.530746 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:35.530920 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:35.531079 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:35.531279 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.532138 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.535032 (+ 2894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.535663 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.535766 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.535898 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:35.535990 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 16:00:35.536073 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":150,"threads_started":1}
I20260808 16:00:35.538623 15342 tablet_service.cc:1467] Processing CreateTablet for tablet 730fc8e0ddb147b7bda708e03bc1844f (DEFAULT_TABLE table=test-table [id=a7bc30ea6cc84df8a4b42582706d6a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:35.538731 15772 tablet_service.cc:1467] Processing CreateTablet for tablet 730fc8e0ddb147b7bda708e03bc1844f (DEFAULT_TABLE table=test-table [id=a7bc30ea6cc84df8a4b42582706d6a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:35.538731 15540 tablet_service.cc:1467] Processing CreateTablet for tablet 730fc8e0ddb147b7bda708e03bc1844f (DEFAULT_TABLE table=test-table [id=a7bc30ea6cc84df8a4b42582706d6a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:35.539561 15342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 730fc8e0ddb147b7bda708e03bc1844f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:35.539714 15772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 730fc8e0ddb147b7bda708e03bc1844f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:35.539709 15540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 730fc8e0ddb147b7bda708e03bc1844f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:35.545989 15921 tablet_bootstrap.cc:492] T 730fc8e0ddb147b7bda708e03bc1844f P 0407f5bd1ae74ceaa6ef0a7dc37631b0: Bootstrap starting.
I20260808 16:00:35.546900 15922 tablet_bootstrap.cc:492] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f: Bootstrap starting.
I20260808 16:00:35.548013 15921 tablet_bootstrap.cc:654] T 730fc8e0ddb147b7bda708e03bc1844f P 0407f5bd1ae74ceaa6ef0a7dc37631b0: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:35.548425 15923 tablet_bootstrap.cc:492] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46: Bootstrap starting.
I20260808 16:00:35.548920 15922 tablet_bootstrap.cc:654] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:35.549291 15921 log.cc:824] T 730fc8e0ddb147b7bda708e03bc1844f P 0407f5bd1ae74ceaa6ef0a7dc37631b0: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:35.549561 15922 log.cc:824] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:35.550307 15923 tablet_bootstrap.cc:654] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:35.551250 15921 tablet_bootstrap.cc:492] T 730fc8e0ddb147b7bda708e03bc1844f P 0407f5bd1ae74ceaa6ef0a7dc37631b0: No bootstrap required, opened a new log
I20260808 16:00:35.551250 15922 tablet_bootstrap.cc:492] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f: No bootstrap required, opened a new log
I20260808 16:00:35.551438 15921 ts_tablet_manager.cc:1397] T 730fc8e0ddb147b7bda708e03bc1844f P 0407f5bd1ae74ceaa6ef0a7dc37631b0: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 16:00:35.551438 15922 ts_tablet_manager.cc:1397] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 16:00:35.551461 15923 log.cc:824] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:35.553027 15923 tablet_bootstrap.cc:492] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46: No bootstrap required, opened a new log
I20260808 16:00:35.553210 15923 ts_tablet_manager.cc:1397] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 16:00:35.555271 15921 raft_consensus.cc:348] T 730fc8e0ddb147b7bda708e03bc1844f P 0407f5bd1ae74ceaa6ef0a7dc37631b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422e93b0fdde40d1980d20a447b1360f" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45623 } } peers { permanent_uuid: "0ab1627a7dca440592162f22cb71da46" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45637 } } peers { permanent_uuid: "0407f5bd1ae74ceaa6ef0a7dc37631b0" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38595 } }
I20260808 16:00:35.555271 15922 raft_consensus.cc:348] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422e93b0fdde40d1980d20a447b1360f" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45623 } } peers { permanent_uuid: "0ab1627a7dca440592162f22cb71da46" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45637 } } peers { permanent_uuid: "0407f5bd1ae74ceaa6ef0a7dc37631b0" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38595 } }
I20260808 16:00:35.555531 15922 raft_consensus.cc:374] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:35.555531 15921 raft_consensus.cc:374] T 730fc8e0ddb147b7bda708e03bc1844f P 0407f5bd1ae74ceaa6ef0a7dc37631b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:35.555589 15921 raft_consensus.cc:729] T 730fc8e0ddb147b7bda708e03bc1844f P 0407f5bd1ae74ceaa6ef0a7dc37631b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0407f5bd1ae74ceaa6ef0a7dc37631b0, State: Initialized, Role: FOLLOWER
I20260808 16:00:35.555662 15922 raft_consensus.cc:729] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 422e93b0fdde40d1980d20a447b1360f, State: Initialized, Role: FOLLOWER
I20260808 16:00:35.556072 15921 consensus_queue.cc:260] T 730fc8e0ddb147b7bda708e03bc1844f P 0407f5bd1ae74ceaa6ef0a7dc37631b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422e93b0fdde40d1980d20a447b1360f" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45623 } } peers { permanent_uuid: "0ab1627a7dca440592162f22cb71da46" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45637 } } peers { permanent_uuid: "0407f5bd1ae74ceaa6ef0a7dc37631b0" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38595 } }
I20260808 16:00:35.556072 15922 consensus_queue.cc:260] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422e93b0fdde40d1980d20a447b1360f" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45623 } } peers { permanent_uuid: "0ab1627a7dca440592162f22cb71da46" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45637 } } peers { permanent_uuid: "0407f5bd1ae74ceaa6ef0a7dc37631b0" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38595 } }
I20260808 16:00:35.556178 15923 raft_consensus.cc:348] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422e93b0fdde40d1980d20a447b1360f" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45623 } } peers { permanent_uuid: "0ab1627a7dca440592162f22cb71da46" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45637 } } peers { permanent_uuid: "0407f5bd1ae74ceaa6ef0a7dc37631b0" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38595 } }
I20260808 16:00:35.556453 15923 raft_consensus.cc:374] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:35.556543 15923 raft_consensus.cc:729] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ab1627a7dca440592162f22cb71da46, State: Initialized, Role: FOLLOWER
I20260808 16:00:35.556931 15923 consensus_queue.cc:260] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422e93b0fdde40d1980d20a447b1360f" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45623 } } peers { permanent_uuid: "0ab1627a7dca440592162f22cb71da46" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45637 } } peers { permanent_uuid: "0407f5bd1ae74ceaa6ef0a7dc37631b0" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38595 } }
I20260808 16:00:35.557058 15921 ts_tablet_manager.cc:1428] T 730fc8e0ddb147b7bda708e03bc1844f P 0407f5bd1ae74ceaa6ef0a7dc37631b0: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 16:00:35.557096 15922 ts_tablet_manager.cc:1428] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 16:00:35.557399 15645 heartbeater.cc:503] Master 127.19.93.62:44509 was elected leader, sending a full tablet report...
I20260808 16:00:35.557814 15923 ts_tablet_manager.cc:1428] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
I20260808 16:00:35.558151 15885 heartbeater.cc:503] Master 127.19.93.62:44509 was elected leader, sending a full tablet report...
I20260808 16:00:35.558261 15435 heartbeater.cc:503] Master 127.19.93.62:44509 was elected leader, sending a full tablet report...
W20260808 16:00:35.576862 15436 tablet.cc:2369] T 730fc8e0ddb147b7bda708e03bc1844f P 0407f5bd1ae74ceaa6ef0a7dc37631b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 16:00:35.673460 15931 raft_consensus.cc:482] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 16:00:35.673663 15931 raft_consensus.cc:504] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422e93b0fdde40d1980d20a447b1360f" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45623 } } peers { permanent_uuid: "0ab1627a7dca440592162f22cb71da46" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45637 } } peers { permanent_uuid: "0407f5bd1ae74ceaa6ef0a7dc37631b0" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38595 } }
I20260808 16:00:35.674887 15931 leader_election.cc:288] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ab1627a7dca440592162f22cb71da46 (127.19.93.3:45637), 0407f5bd1ae74ceaa6ef0a7dc37631b0 (127.19.93.1:38595)
I20260808 16:00:35.678534 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.675224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:42127 (local address 127.19.93.3:45637)
0808 16:00:35.675396 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:35.675400 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:35.675417 (+ 17us) server_negotiation.cc:407] Connection header received
0808 16:00:35.675580 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:35.675584 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:35.675643 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:35.675712 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:35.676040 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.676644 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.677647 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.678042 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.678135 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.678200 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:35.678356 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 16:00:35.678434 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 16:00:35.678534 15652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.675126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:45637 (local address 127.19.93.2:42127)
0808 16:00:35.675333 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:35.675348 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:35.675442 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:35.675773 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:35.675776 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:35.675790 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:35.675926 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:35.675933 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.676756 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.676760 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:35.677528 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:35.677537 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.678151 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.678154 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:35.678251 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.678270 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 16:00:35.678333 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 16:00:35.678401 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128}
I20260808 16:00:35.678751 15920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.675459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:60053 (local address 127.19.93.1:38595)
0808 16:00:35.675583 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:35.675587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:35.675717 (+ 130us) server_negotiation.cc:407] Connection header received
0808 16:00:35.675915 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:35.675918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:35.675971 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:35.676049 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:35.676422 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.676902 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.677887 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.678263 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.678353 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.678411 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:35.678579 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 16:00:35.678650 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 16:00:35.678754 15933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.675165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:38595 (local address 127.19.93.2:60053)
0808 16:00:35.675631 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:35.675645 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:35.675752 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:35.676179 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:35.676182 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:35.676196 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:35.676307 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:35.676314 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.677010 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.677013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:35.677767 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:35.677776 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.678373 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.678377 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:35.678470 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.678487 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 16:00:35.678551 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 16:00:35.678617 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":121,"threads_started":1}
I20260808 16:00:35.679193 15815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "730fc8e0ddb147b7bda708e03bc1844f" candidate_uuid: "422e93b0fdde40d1980d20a447b1360f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ab1627a7dca440592162f22cb71da46" is_pre_election: true
I20260808 16:00:35.679445 15369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "730fc8e0ddb147b7bda708e03bc1844f" candidate_uuid: "422e93b0fdde40d1980d20a447b1360f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0407f5bd1ae74ceaa6ef0a7dc37631b0" is_pre_election: true
I20260808 16:00:35.679512 15815 raft_consensus.cc:2454] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 422e93b0fdde40d1980d20a447b1360f in term 0.
I20260808 16:00:35.679723 15369 raft_consensus.cc:2454] T 730fc8e0ddb147b7bda708e03bc1844f P 0407f5bd1ae74ceaa6ef0a7dc37631b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 422e93b0fdde40d1980d20a447b1360f in term 0.
I20260808 16:00:35.679999 15468 leader_election.cc:302] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ab1627a7dca440592162f22cb71da46, 422e93b0fdde40d1980d20a447b1360f; no voters:
I20260808 16:00:35.680307 15931 raft_consensus.cc:2781] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 16:00:35.680392 15931 raft_consensus.cc:482] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 16:00:35.680442 15931 raft_consensus.cc:3037] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:35.681471 15931 raft_consensus.cc:504] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422e93b0fdde40d1980d20a447b1360f" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45623 } } peers { permanent_uuid: "0ab1627a7dca440592162f22cb71da46" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45637 } } peers { permanent_uuid: "0407f5bd1ae74ceaa6ef0a7dc37631b0" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38595 } }
I20260808 16:00:35.681778 15931 leader_election.cc:288] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [CANDIDATE]: Term 1 election: Requested vote from peers 0ab1627a7dca440592162f22cb71da46 (127.19.93.3:45637), 0407f5bd1ae74ceaa6ef0a7dc37631b0 (127.19.93.1:38595)
I20260808 16:00:35.682107 15815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "730fc8e0ddb147b7bda708e03bc1844f" candidate_uuid: "422e93b0fdde40d1980d20a447b1360f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ab1627a7dca440592162f22cb71da46"
I20260808 16:00:35.682161 15369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "730fc8e0ddb147b7bda708e03bc1844f" candidate_uuid: "422e93b0fdde40d1980d20a447b1360f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0407f5bd1ae74ceaa6ef0a7dc37631b0"
I20260808 16:00:35.682224 15815 raft_consensus.cc:3037] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:35.682279 15369 raft_consensus.cc:3037] T 730fc8e0ddb147b7bda708e03bc1844f P 0407f5bd1ae74ceaa6ef0a7dc37631b0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:35.683211 15815 raft_consensus.cc:2454] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 422e93b0fdde40d1980d20a447b1360f in term 1.
I20260808 16:00:35.683292 15369 raft_consensus.cc:2454] T 730fc8e0ddb147b7bda708e03bc1844f P 0407f5bd1ae74ceaa6ef0a7dc37631b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 422e93b0fdde40d1980d20a447b1360f in term 1.
I20260808 16:00:35.683513 15468 leader_election.cc:302] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ab1627a7dca440592162f22cb71da46, 422e93b0fdde40d1980d20a447b1360f; no voters:
I20260808 16:00:35.683710 15931 raft_consensus.cc:2781] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:35.683918 15931 raft_consensus.cc:686] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [term 1 LEADER]: Becoming Leader. State: Replica: 422e93b0fdde40d1980d20a447b1360f, State: Running, Role: LEADER
I20260808 16:00:35.684273 15931 consensus_queue.cc:237] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422e93b0fdde40d1980d20a447b1360f" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45623 } } peers { permanent_uuid: "0ab1627a7dca440592162f22cb71da46" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45637 } } peers { permanent_uuid: "0407f5bd1ae74ceaa6ef0a7dc37631b0" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38595 } }
I20260808 16:00:35.687232 15137 catalog_manager.cc:5495] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f reported cstate change: term changed from 0 to 1, leader changed from <none> to 422e93b0fdde40d1980d20a447b1360f (127.19.93.2). New cstate: current_term: 1 leader_uuid: "422e93b0fdde40d1980d20a447b1360f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422e93b0fdde40d1980d20a447b1360f" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ab1627a7dca440592162f22cb71da46" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0407f5bd1ae74ceaa6ef0a7dc37631b0" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38595 } health_report { overall_health: UNKNOWN } } }
I20260808 16:00:35.720135 15913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.717063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37442 (local address 127.19.93.2:45623)
0808 16:00:35.717191 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:35.717195 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:35.717208 (+ 13us) server_negotiation.cc:407] Connection header received
0808 16:00:35.717279 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:35.717281 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:35.717332 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:35.717425 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 16:00:35.717624 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.718104 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.718874 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:35.719085 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:35.719162 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:35.719401 (+ 239us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 16:00:35.719799 (+ 398us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 16:00:35.719886 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:35.719914 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 16:00:35.719958 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 16:00:35.725615 15369 raft_consensus.cc:1261] T 730fc8e0ddb147b7bda708e03bc1844f P 0407f5bd1ae74ceaa6ef0a7dc37631b0 [term 1 FOLLOWER]: Refusing update from remote peer 422e93b0fdde40d1980d20a447b1360f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 16:00:35.725615 15815 raft_consensus.cc:1261] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46 [term 1 FOLLOWER]: Refusing update from remote peer 422e93b0fdde40d1980d20a447b1360f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 16:00:35.726275 15935 consensus_queue.cc:1035] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0407f5bd1ae74ceaa6ef0a7dc37631b0" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 16:00:35.726454 15931 consensus_queue.cc:1035] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ab1627a7dca440592162f22cb71da46" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 16:00:35.733909 15942 mvcc.cc:205] Tried to move back new op lower bound from 7316295007125151744 to 7316295006965186560. Current Snapshot: MvccSnapshot[applied={T|T < 7316295007125151744}]
I20260808 16:00:35.734196 15943 mvcc.cc:205] Tried to move back new op lower bound from 7316295007125151744 to 7316295006965186560. Current Snapshot: MvccSnapshot[applied={T|T < 7316295007125151744}]
I20260808 16:00:35.742308 15133 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 16:00:35.742451 15133 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 16:00:35.744709 15133 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a1480b046af545dbbc6b42537c8a8c09: Sending DeleteTablet for 3 replicas of tablet 730fc8e0ddb147b7bda708e03bc1844f
I20260808 16:00:35.745415 15772 tablet_service.cc:1514] Processing DeleteTablet for tablet 730fc8e0ddb147b7bda708e03bc1844f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:35 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:53710
I20260808 16:00:35.745476 15540 tablet_service.cc:1514] Processing DeleteTablet for tablet 730fc8e0ddb147b7bda708e03bc1844f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:35 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:37434
I20260808 16:00:35.745476 15342 tablet_service.cc:1514] Processing DeleteTablet for tablet 730fc8e0ddb147b7bda708e03bc1844f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:35 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:36376
I20260808 16:00:35.745860 15959 tablet_replica.cc:330] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46: stopping tablet replica
I20260808 16:00:35.746141 15959 raft_consensus.cc:2229] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 16:00:35.746503 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 15237
I20260808 16:00:35.746517 15959 raft_consensus.cc:2258] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 16:00:35.755944 15959 ts_tablet_manager.cc:1905] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 16:00:35.759294 15961 tablet_replica.cc:330] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f: stopping tablet replica
I20260808 16:00:35.759614 15961 raft_consensus.cc:2229] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [term 1 LEADER]: Raft consensus shutting down.
I20260808 16:00:35.760015 15961 raft_consensus.cc:2258] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 16:00:35.760372 15959 ts_tablet_manager.cc:1918] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 16:00:35.760468 15959 log.cc:1196] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/730fc8e0ddb147b7bda708e03bc1844f
I20260808 16:00:35.760839 15959 ts_tablet_manager.cc:1939] T 730fc8e0ddb147b7bda708e03bc1844f P 0ab1627a7dca440592162f22cb71da46: Deleting consensus metadata
I20260808 16:00:35.761512 15961 ts_tablet_manager.cc:1905] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 16:00:35.762241 15109 catalog_manager.cc:4841] TS 0ab1627a7dca440592162f22cb71da46 (127.19.93.3:45637): tablet 730fc8e0ddb147b7bda708e03bc1844f (table test-table [id=a7bc30ea6cc84df8a4b42582706d6a1a]) successfully deleted
I20260808 16:00:35.764173 15961 ts_tablet_manager.cc:1918] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 16:00:35.764313 15961 log.cc:1196] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/730fc8e0ddb147b7bda708e03bc1844f
I20260808 16:00:35.764655 15961 ts_tablet_manager.cc:1939] T 730fc8e0ddb147b7bda708e03bc1844f P 422e93b0fdde40d1980d20a447b1360f: Deleting consensus metadata
I20260808 16:00:35.765775 15106 catalog_manager.cc:4841] TS 422e93b0fdde40d1980d20a447b1360f (127.19.93.2:45623): tablet 730fc8e0ddb147b7bda708e03bc1844f (table test-table [id=a7bc30ea6cc84df8a4b42582706d6a1a]) successfully deleted
W20260808 16:00:35.769194 15112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:38595 (error 108)
I20260808 16:00:35.769992 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 15442
I20260808 16:00:35.770253 15915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:35.769959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:38595 (local address 127.0.0.1:36386)
0808 16:00:35.770099 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:35.770169 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:38595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 16:00:35.796509 15112 catalog_manager.cc:4584] TS 0407f5bd1ae74ceaa6ef0a7dc37631b0 (127.19.93.1:38595): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 730fc8e0ddb147b7bda708e03bc1844f: Network error: Client connection negotiation failed: client connection to 127.19.93.1:38595: connect: Connection refused (error 111)
I20260808 16:00:35.801512 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 15661
I20260808 16:00:35.810846 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 15081
2026-08-08T16:00:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2431 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T16:00:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:00:35Z Disabled control of system clock
I20260808 16:00:35.844660 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:33875
--webserver_interface=127.19.93.62
--webserver_port=0
--builtin_ntp_servers=127.19.93.20:35729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:33875
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 16:00:35.952164 15972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:35.952391 15972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:35.952425 15972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:35.956249 15972 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:35.956292 15972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:35.956306 15972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:35.956321 15972 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:35.956333 15972 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:35.960880 15972 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:35729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:33875
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:33875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:35.961786 15972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:35.963052 15972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:35.970968 15982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:35.971014 15980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:35.971297 15972 server_base.cc:1034] running on GCE node
W20260808 16:00:35.970986 15979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:35.972441 15972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:35.973405 15972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:35.981403 15972 hybrid_clock.cc:648] HybridClock initialized: now 1786204835981369 us; error 43 us; skew 500 ppm
I20260808 16:00:35.983634 15972 webserver.cc:460] Webserver started at http://127.19.93.62:37331/ using document root <none> and password file <none>
I20260808 16:00:35.984283 15972 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:35.984350 15972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:35.984552 15972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:35.986572 15972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "0cb166594edd4cc28dc4f511d94c8ff5"
format_stamp: "Formatted at 2026-08-08 16:00:35 on dist-test-slave-lgr5"
server_key: "e03ee82a04d21a7f118c6a43730b8b61"
server_key_iv: "c3f703ae7536011d8daa4e1e0eb4069e"
server_key_version: "encryptionkey@0"
I20260808 16:00:35.987134 15972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "0cb166594edd4cc28dc4f511d94c8ff5"
format_stamp: "Formatted at 2026-08-08 16:00:35 on dist-test-slave-lgr5"
server_key: "e03ee82a04d21a7f118c6a43730b8b61"
server_key_iv: "c3f703ae7536011d8daa4e1e0eb4069e"
server_key_version: "encryptionkey@0"
I20260808 16:00:35.990674 15972 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 16:00:35.993021 15993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:35.994133 15972 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:35.994239 15972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "0cb166594edd4cc28dc4f511d94c8ff5"
format_stamp: "Formatted at 2026-08-08 16:00:35 on dist-test-slave-lgr5"
server_key: "e03ee82a04d21a7f118c6a43730b8b61"
server_key_iv: "c3f703ae7536011d8daa4e1e0eb4069e"
server_key_version: "encryptionkey@0"
I20260808 16:00:35.994334 15972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:36.007937 15972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:36.008569 15972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:36.008730 15972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:36.015419 15972 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:33875
I20260808 16:00:36.015446 16071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:33875 every 8 connection(s)
I20260808 16:00:36.016328 15972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:36.019301 16072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:36.019970 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 15972
I20260808 16:00:36.020102 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:00:36.020370 19828 external_mini_cluster.cc:1428] Setting key ca14c2002ef830553ba640695921a14b
I20260808 16:00:36.025091 16072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5: Bootstrap starting.
I20260808 16:00:36.027534 16072 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:36.028318 16072 log.cc:824] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:36.029076 16080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.021679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59288 (local address 127.19.93.62:33875)
0808 16:00:36.022244 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:36.022264 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:36.022299 (+ 35us) server_negotiation.cc:407] Connection header received
0808 16:00:36.022936 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:36.022952 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:36.023316 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:36.023581 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:36.023888 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.024892 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.026067 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.026522 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.026639 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.027419 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:36.027424 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:36.027435 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:36.027823 (+ 388us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:36.027877 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:36.027898 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:36.027970 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:36.028146 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 16:00:36.028403 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":109,"threads_started":1}
I20260808 16:00:36.030089 16072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5: No bootstrap required, opened a new log
I20260808 16:00:36.033625 16072 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb166594edd4cc28dc4f511d94c8ff5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 33875 } }
I20260808 16:00:36.033823 16072 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:36.033870 16072 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cb166594edd4cc28dc4f511d94c8ff5, State: Initialized, Role: FOLLOWER
I20260808 16:00:36.034221 16072 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb166594edd4cc28dc4f511d94c8ff5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 33875 } }
I20260808 16:00:36.034343 16072 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:36.034389 16072 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:36.034456 16072 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:36.035224 16072 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb166594edd4cc28dc4f511d94c8ff5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 33875 } }
I20260808 16:00:36.035516 16072 leader_election.cc:302] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0cb166594edd4cc28dc4f511d94c8ff5; no voters:
I20260808 16:00:36.035743 16072 leader_election.cc:288] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:00:36.035838 16083 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:36.036054 16083 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [term 1 LEADER]: Becoming Leader. State: Replica: 0cb166594edd4cc28dc4f511d94c8ff5, State: Running, Role: LEADER
I20260808 16:00:36.036396 16083 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb166594edd4cc28dc4f511d94c8ff5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 33875 } }
I20260808 16:00:36.037039 16072 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:36.038069 16086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0cb166594edd4cc28dc4f511d94c8ff5. Latest consensus state: current_term: 1 leader_uuid: "0cb166594edd4cc28dc4f511d94c8ff5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb166594edd4cc28dc4f511d94c8ff5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 33875 } } }
I20260808 16:00:36.038053 16085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0cb166594edd4cc28dc4f511d94c8ff5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb166594edd4cc28dc4f511d94c8ff5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 33875 } } }
I20260808 16:00:36.038192 16086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:36.038192 16085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:36.038704 16094 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:36.041790 16094 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:36.047019 16094 catalog_manager.cc:1347] Generated new cluster ID: 7a22088ec05546fc82f2ab3228b51707
I20260808 16:00:36.047081 16094 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:36.053409 16094 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:00:36.054276 16094 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:36.064649 16094 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5: Generated new TSK 0
I20260808 16:00:36.065265 16094 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:00:36.072691 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:33875
--builtin_ntp_servers=127.19.93.20:35729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 16:00:36.182721 16123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:36.182966 16123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:36.183004 16123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:36.186920 16123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:36.186976 16123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:36.187029 16123 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 16:00:36.191556 16123 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:35729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:33875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:36.192488 16123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:36.193761 16123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:36.203105 16135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:36.203161 16130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:36.203203 16131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:36.203338 16123 server_base.cc:1034] running on GCE node
I20260808 16:00:36.203722 16123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:36.204356 16123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:36.205538 16123 hybrid_clock.cc:648] HybridClock initialized: now 1786204836205523 us; error 25 us; skew 500 ppm
I20260808 16:00:36.207353 16123 webserver.cc:460] Webserver started at http://127.19.93.1:36351/ using document root <none> and password file <none>
I20260808 16:00:36.207891 16123 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:36.207958 16123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:36.208204 16123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:36.210194 16123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "8709434d147b4c898aef4d374c29ec4d"
format_stamp: "Formatted at 2026-08-08 16:00:36 on dist-test-slave-lgr5"
server_key: "069d8d17468e014f6fafbe7835246cbd"
server_key_iv: "11951a4937f22bfc0518bead0b64c878"
server_key_version: "encryptionkey@0"
I20260808 16:00:36.210858 16123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "8709434d147b4c898aef4d374c29ec4d"
format_stamp: "Formatted at 2026-08-08 16:00:36 on dist-test-slave-lgr5"
server_key: "069d8d17468e014f6fafbe7835246cbd"
server_key_iv: "11951a4937f22bfc0518bead0b64c878"
server_key_version: "encryptionkey@0"
I20260808 16:00:36.214439 16123 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 16:00:36.216781 16144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:36.217913 16123 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:36.218021 16123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "8709434d147b4c898aef4d374c29ec4d"
format_stamp: "Formatted at 2026-08-08 16:00:36 on dist-test-slave-lgr5"
server_key: "069d8d17468e014f6fafbe7835246cbd"
server_key_iv: "11951a4937f22bfc0518bead0b64c878"
server_key_version: "encryptionkey@0"
I20260808 16:00:36.218117 16123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:36.228130 16123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:36.228688 16123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:36.228838 16123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:36.229343 16123 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:36.230204 16123 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:36.230252 16123 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:36.230301 16123 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:36.230330 16123 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:36.239069 16123 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:35683
I20260808 16:00:36.239127 16319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:35683 every 8 connection(s)
I20260808 16:00:36.239884 16123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 16:00:36.248644 16080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.241576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:38133 (local address 127.19.93.62:33875)
0808 16:00:36.241707 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:36.241711 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:36.242688 (+ 977us) server_negotiation.cc:407] Connection header received
0808 16:00:36.244040 (+ 1352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:36.244044 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:36.244125 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:36.244205 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:36.245075 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.245630 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.246756 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.246995 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.247093 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.248071 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:36.248075 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:36.248102 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:36.248118 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:36.248143 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:36.248155 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:36.248220 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:36.248413 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 16:00:36.248483 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 16:00:36.249372 16324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.241906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:33875 (local address 127.19.93.1:38133)
0808 16:00:36.242544 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:36.242584 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:36.243832 (+ 1248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:36.244398 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:36.244405 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:36.244483 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:36.244926 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:36.244939 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.245765 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.245768 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:36.246626 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:36.246637 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.247151 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.247156 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:36.247321 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.247820 (+ 499us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 16:00:36.247822 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:36.247858 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 16:00:36.247918 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:36.248247 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:36.248256 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:36.248260 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 16:00:36.248400 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 16:00:36.248654 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":107,"threads_started":1}
I20260808 16:00:36.249619 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 16123
I20260808 16:00:36.249743 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 16:00:36.250100 19828 external_mini_cluster.cc:1428] Setting key 2cb7a73d6ca42b65458594521f0e4697
I20260808 16:00:36.250528 16321 heartbeater.cc:347] Connected to a master server at 127.19.93.62:33875
I20260808 16:00:36.250738 16321 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:36.251217 16321 heartbeater.cc:511] Master 127.19.93.62:33875 requested a full tablet report, sending...
I20260808 16:00:36.252022 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:33875
--builtin_ntp_servers=127.19.93.20:35729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 16:00:36.252701 16020 ts_manager.cc:194] Registered new tserver with Master: 8709434d147b4c898aef4d374c29ec4d (127.19.93.1:35683)
I20260808 16:00:36.254004 16020 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.93.1:38133
W20260808 16:00:36.364523 16325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:36.364753 16325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:36.364801 16325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:36.368713 16325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:36.368757 16325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:36.368825 16325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 16:00:36.373405 16325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:35729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:33875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:36.374285 16325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:36.375524 16325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:36.384469 16335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:36.384469 16333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:36.384485 16337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:36.384739 16325 server_base.cc:1034] running on GCE node
I20260808 16:00:36.385130 16325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:36.385716 16325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:36.386879 16325 hybrid_clock.cc:648] HybridClock initialized: now 1786204836386858 us; error 39 us; skew 500 ppm
I20260808 16:00:36.388598 16325 webserver.cc:460] Webserver started at http://127.19.93.2:42863/ using document root <none> and password file <none>
I20260808 16:00:36.389094 16325 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:36.389158 16325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:36.389338 16325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:36.391198 16325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "5340a00a0edd471bba2d28ab9d013f1d"
format_stamp: "Formatted at 2026-08-08 16:00:36 on dist-test-slave-lgr5"
server_key: "60cc665a9a8688c746d2736f22bc73f3"
server_key_iv: "d2331e758f1d897e488dbf07fc6b6f9a"
server_key_version: "encryptionkey@0"
I20260808 16:00:36.391702 16325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "5340a00a0edd471bba2d28ab9d013f1d"
format_stamp: "Formatted at 2026-08-08 16:00:36 on dist-test-slave-lgr5"
server_key: "60cc665a9a8688c746d2736f22bc73f3"
server_key_iv: "d2331e758f1d897e488dbf07fc6b6f9a"
server_key_version: "encryptionkey@0"
I20260808 16:00:36.394989 16325 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 16:00:36.397234 16350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:36.398311 16325 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 16:00:36.398416 16325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "5340a00a0edd471bba2d28ab9d013f1d"
format_stamp: "Formatted at 2026-08-08 16:00:36 on dist-test-slave-lgr5"
server_key: "60cc665a9a8688c746d2736f22bc73f3"
server_key_iv: "d2331e758f1d897e488dbf07fc6b6f9a"
server_key_version: "encryptionkey@0"
I20260808 16:00:36.398502 16325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:36.411834 16325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:36.412433 16325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:36.412580 16325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:36.413067 16325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:36.413897 16325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:36.413944 16325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:36.413992 16325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:36.414018 16325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:36.422034 16325 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:45605
I20260808 16:00:36.422083 16533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:45605 every 8 connection(s)
I20260808 16:00:36.422868 16325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 16:00:36.429934 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 16325
I20260808 16:00:36.430050 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 16:00:36.430331 19828 external_mini_cluster.cc:1428] Setting key 4ae64c70b0aca2ed6cf85945089659d9
I20260808 16:00:36.431326 16080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.424447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:58045 (local address 127.19.93.62:33875)
0808 16:00:36.424571 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:36.424575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:36.425506 (+ 931us) server_negotiation.cc:407] Connection header received
0808 16:00:36.426821 (+ 1315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:36.426825 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:36.426886 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:36.426958 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:36.427793 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.428374 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.429475 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.429722 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.429829 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.430863 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:36.430867 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:36.430869 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:36.430883 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:36.430919 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:36.430927 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:36.430987 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:36.431129 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 16:00:36.431188 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 16:00:36.432165 16541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.424770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:33875 (local address 127.19.93.2:58045)
0808 16:00:36.425360 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:36.425397 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:36.426614 (+ 1217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:36.427129 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:36.427135 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:36.427213 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:36.427647 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:36.427660 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.428496 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.428499 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:36.429349 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:36.429358 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.429876 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.429879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:36.430042 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.430626 (+ 584us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 16:00:36.430627 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:36.430662 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 16:00:36.430720 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:36.431000 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:36.431009 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:36.431014 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 16:00:36.431120 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 16:00:36.431370 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":114,"threads_started":1}
I20260808 16:00:36.432286 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:33875
--builtin_ntp_servers=127.19.93.20:35729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 16:00:36.433148 16534 heartbeater.cc:347] Connected to a master server at 127.19.93.62:33875
I20260808 16:00:36.433369 16534 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:36.433887 16534 heartbeater.cc:511] Master 127.19.93.62:33875 requested a full tablet report, sending...
I20260808 16:00:36.434891 16020 ts_manager.cc:194] Registered new tserver with Master: 5340a00a0edd471bba2d28ab9d013f1d (127.19.93.2:45605)
I20260808 16:00:36.435429 16020 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.93.2:58045
W20260808 16:00:36.554700 16542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:36.554916 16542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:36.554952 16542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:36.558831 16542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:36.558883 16542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:36.558954 16542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 16:00:36.563472 16542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:35729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:33875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:36.564442 16542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:36.565721 16542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:36.574733 16552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:36.574750 16548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:36.574753 16550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:36.575078 16542 server_base.cc:1034] running on GCE node
I20260808 16:00:36.575460 16542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:36.576056 16542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:36.577240 16542 hybrid_clock.cc:648] HybridClock initialized: now 1786204836577221 us; error 30 us; skew 500 ppm
I20260808 16:00:36.578889 16542 webserver.cc:460] Webserver started at http://127.19.93.3:45037/ using document root <none> and password file <none>
I20260808 16:00:36.579416 16542 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:36.579481 16542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:36.579679 16542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:36.581722 16542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "66d4fa5a28b54ed9b41be8bc94e60c58"
format_stamp: "Formatted at 2026-08-08 16:00:36 on dist-test-slave-lgr5"
server_key: "cab40fbba82e1b56065bf6e5bfbffb2f"
server_key_iv: "df9ef0a021c444891121b7627e8fc81a"
server_key_version: "encryptionkey@0"
I20260808 16:00:36.582235 16542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "66d4fa5a28b54ed9b41be8bc94e60c58"
format_stamp: "Formatted at 2026-08-08 16:00:36 on dist-test-slave-lgr5"
server_key: "cab40fbba82e1b56065bf6e5bfbffb2f"
server_key_iv: "df9ef0a021c444891121b7627e8fc81a"
server_key_version: "encryptionkey@0"
I20260808 16:00:36.585711 16542 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260808 16:00:36.587899 16563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:36.589071 16542 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:00:36.589174 16542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "66d4fa5a28b54ed9b41be8bc94e60c58"
format_stamp: "Formatted at 2026-08-08 16:00:36 on dist-test-slave-lgr5"
server_key: "cab40fbba82e1b56065bf6e5bfbffb2f"
server_key_iv: "df9ef0a021c444891121b7627e8fc81a"
server_key_version: "encryptionkey@0"
I20260808 16:00:36.589263 16542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:36.599059 16542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:36.599622 16542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:36.599776 16542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:36.600337 16542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:36.601193 16542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:36.601240 16542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:36.601289 16542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:36.601315 16542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:36.609391 16542 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:37427
I20260808 16:00:36.609470 16741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:37427 every 8 connection(s)
I20260808 16:00:36.610210 16542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 16:00:36.618737 16080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.611825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:37291 (local address 127.19.93.62:33875)
0808 16:00:36.611956 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:36.611959 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:36.612942 (+ 983us) server_negotiation.cc:407] Connection header received
0808 16:00:36.614284 (+ 1342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:36.614288 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:36.614345 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:36.614419 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:36.615285 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.615818 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.616979 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.617204 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.617296 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.618276 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:36.618279 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:36.618281 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:36.618294 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:36.618313 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:36.618321 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:36.618381 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:36.618520 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 16:00:36.618595 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 16:00:36.619496 16745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.612210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:33875 (local address 127.19.93.3:37291)
0808 16:00:36.612808 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:36.612846 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:36.614085 (+ 1239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:36.614597 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:36.614604 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:36.614682 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:36.615147 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:36.615161 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.615944 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.615947 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:36.616860 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:36.616871 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.617345 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.617349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:36.617507 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.618019 (+ 512us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 16:00:36.618021 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:36.618073 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 16:00:36.618135 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:36.618390 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:36.618399 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:36.618405 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 16:00:36.618512 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 16:00:36.618773 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":101,"threads_started":1}
I20260808 16:00:36.619771 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 16542
I20260808 16:00:36.619870 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 16:00:36.620221 19828 external_mini_cluster.cc:1428] Setting key e09e25918204317c2c71dccf9595d105
I20260808 16:00:36.620673 16742 heartbeater.cc:347] Connected to a master server at 127.19.93.62:33875
I20260808 16:00:36.620903 16742 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:36.621528 16742 heartbeater.cc:511] Master 127.19.93.62:33875 requested a full tablet report, sending...
I20260808 16:00:36.622539 16020 ts_manager.cc:194] Registered new tserver with Master: 66d4fa5a28b54ed9b41be8bc94e60c58 (127.19.93.3:37427)
I20260808 16:00:36.623051 16020 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.93.3:37291
I20260808 16:00:36.633767 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 16:00:36.639155 16080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.635620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59292 (local address 127.19.93.62:33875)
0808 16:00:36.635751 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:36.635755 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:36.635893 (+ 138us) server_negotiation.cc:407] Connection header received
0808 16:00:36.636008 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:36.636011 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:36.636056 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:36.636154 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:36.636417 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.636909 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.637729 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.637935 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.638020 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.638781 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:36.638785 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:36.638788 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:36.638800 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:36.638818 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:36.638825 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:36.638882 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:36.638973 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 16:00:36.639027 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 16:00:36.641652 16020 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59292:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 16:00:36.644596 16020 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 16:00:36.658329 16772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.652686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:35683 (local address 127.0.0.1:41348)
0808 16:00:36.653662 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:36.653674 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:36.653787 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:36.654307 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:36.654313 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:36.654335 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:36.654466 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:36.654474 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.656028 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.656031 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:36.657021 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:36.657030 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.657821 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.657825 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:36.657931 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.657968 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 16:00:36.658070 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 16:00:36.658190 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":914,"mutex_wait_us":3,"thread_start_us":103,"threads_started":1}
I20260808 16:00:36.658654 16767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.653220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:37427 (local address 127.0.0.1:45584)
0808 16:00:36.653836 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:36.653848 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:36.653932 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:36.654454 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:36.654457 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:36.654475 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:36.654577 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:36.654583 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.656013 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.656016 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:36.657177 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:36.657185 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.658245 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.658249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:36.658337 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.658359 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 16:00:36.658429 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 16:00:36.658492 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"mutex_wait_us":16,"thread_start_us":92,"threads_started":1}
I20260808 16:00:36.658648 16768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.652709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56932 (local address 127.19.93.2:45605)
0808 16:00:36.653645 (+ 936us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:36.653656 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:36.653681 (+ 25us) server_negotiation.cc:407] Connection header received
0808 16:00:36.654201 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:36.654206 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:36.654377 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:36.654520 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:36.654809 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.655552 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.657112 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.657870 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.657976 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.658165 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:36.658403 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 16:00:36.658503 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":835,"thread_start_us":136,"threads_started":1}
I20260808 16:00:36.658825 16773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.653613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45584 (local address 127.19.93.3:37427)
0808 16:00:36.654100 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:36.654112 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:36.654136 (+ 24us) server_negotiation.cc:407] Connection header received
0808 16:00:36.654200 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:36.654204 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:36.654338 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:36.654463 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:36.654690 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.655895 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.657287 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.658030 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.658124 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.658279 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:36.658575 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 16:00:36.658674 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":143,"threads_started":1}
I20260808 16:00:36.658506 16765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.652535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:45605 (local address 127.0.0.1:56932)
0808 16:00:36.653334 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:36.653407 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:36.654046 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:36.654607 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:36.654610 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:36.654625 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:36.654704 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:36.654708 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.655663 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.655667 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:36.656979 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:36.656990 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.658078 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.658082 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:36.658165 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.658186 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 16:00:36.658250 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 16:00:36.658303 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"mutex_wait_us":35,"thread_start_us":70,"threads_started":1}
I20260808 16:00:36.659907 16771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.653050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41348 (local address 127.19.93.1:35683)
0808 16:00:36.653443 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:36.653455 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:36.653759 (+ 304us) server_negotiation.cc:407] Connection header received
0808 16:00:36.653947 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:36.653953 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:36.654141 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:36.654614 (+ 473us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:36.654743 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.655896 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.657142 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.657702 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.657800 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.658001 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:36.659639 (+ 1638us) server_negotiation.cc:299] Negotiation successful
0808 16:00:36.659743 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":107,"threads_started":1}
I20260808 16:00:36.661686 16643 tablet_service.cc:1467] Processing CreateTablet for tablet 5d5e32e76a7648bcbb46fd529335930f (DEFAULT_TABLE table=test-table [id=99c8aeb2d3f34efda93b5b88b335f582]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:36.661720 16432 tablet_service.cc:1467] Processing CreateTablet for tablet 5d5e32e76a7648bcbb46fd529335930f (DEFAULT_TABLE table=test-table [id=99c8aeb2d3f34efda93b5b88b335f582]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:36.662614 16643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d5e32e76a7648bcbb46fd529335930f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:36.662731 16432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d5e32e76a7648bcbb46fd529335930f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:36.662364 16222 tablet_service.cc:1467] Processing CreateTablet for tablet 5d5e32e76a7648bcbb46fd529335930f (DEFAULT_TABLE table=test-table [id=99c8aeb2d3f34efda93b5b88b335f582]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:36.663254 16222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d5e32e76a7648bcbb46fd529335930f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:36.668700 16774 tablet_bootstrap.cc:492] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58: Bootstrap starting.
I20260808 16:00:36.669620 16776 tablet_bootstrap.cc:492] T 5d5e32e76a7648bcbb46fd529335930f P 8709434d147b4c898aef4d374c29ec4d: Bootstrap starting.
I20260808 16:00:36.671175 16774 tablet_bootstrap.cc:654] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:36.671587 16776 tablet_bootstrap.cc:654] T 5d5e32e76a7648bcbb46fd529335930f P 8709434d147b4c898aef4d374c29ec4d: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:36.672022 16774 log.cc:824] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:36.672364 16777 tablet_bootstrap.cc:492] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d: Bootstrap starting.
I20260808 16:00:36.672405 16776 log.cc:824] T 5d5e32e76a7648bcbb46fd529335930f P 8709434d147b4c898aef4d374c29ec4d: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:36.674180 16774 tablet_bootstrap.cc:492] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58: No bootstrap required, opened a new log
I20260808 16:00:36.674293 16776 tablet_bootstrap.cc:492] T 5d5e32e76a7648bcbb46fd529335930f P 8709434d147b4c898aef4d374c29ec4d: No bootstrap required, opened a new log
I20260808 16:00:36.674396 16774 ts_tablet_manager.cc:1397] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 16:00:36.674487 16777 tablet_bootstrap.cc:654] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:36.674515 16776 ts_tablet_manager.cc:1397] T 5d5e32e76a7648bcbb46fd529335930f P 8709434d147b4c898aef4d374c29ec4d: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260808 16:00:36.675302 16777 log.cc:824] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:36.677223 16777 tablet_bootstrap.cc:492] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d: No bootstrap required, opened a new log
I20260808 16:00:36.677400 16777 ts_tablet_manager.cc:1397] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 16:00:36.677675 16774 raft_consensus.cc:348] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340a00a0edd471bba2d28ab9d013f1d" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45605 } } peers { permanent_uuid: "8709434d147b4c898aef4d374c29ec4d" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 35683 } } peers { permanent_uuid: "66d4fa5a28b54ed9b41be8bc94e60c58" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37427 } }
I20260808 16:00:36.677873 16774 raft_consensus.cc:374] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:36.677963 16774 raft_consensus.cc:729] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d4fa5a28b54ed9b41be8bc94e60c58, State: Initialized, Role: FOLLOWER
I20260808 16:00:36.678359 16774 consensus_queue.cc:260] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340a00a0edd471bba2d28ab9d013f1d" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45605 } } peers { permanent_uuid: "8709434d147b4c898aef4d374c29ec4d" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 35683 } } peers { permanent_uuid: "66d4fa5a28b54ed9b41be8bc94e60c58" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37427 } }
I20260808 16:00:36.678402 16776 raft_consensus.cc:348] T 5d5e32e76a7648bcbb46fd529335930f P 8709434d147b4c898aef4d374c29ec4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340a00a0edd471bba2d28ab9d013f1d" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45605 } } peers { permanent_uuid: "8709434d147b4c898aef4d374c29ec4d" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 35683 } } peers { permanent_uuid: "66d4fa5a28b54ed9b41be8bc94e60c58" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37427 } }
I20260808 16:00:36.678700 16776 raft_consensus.cc:374] T 5d5e32e76a7648bcbb46fd529335930f P 8709434d147b4c898aef4d374c29ec4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:36.678791 16776 raft_consensus.cc:729] T 5d5e32e76a7648bcbb46fd529335930f P 8709434d147b4c898aef4d374c29ec4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8709434d147b4c898aef4d374c29ec4d, State: Initialized, Role: FOLLOWER
I20260808 16:00:36.678946 16742 heartbeater.cc:503] Master 127.19.93.62:33875 was elected leader, sending a full tablet report...
I20260808 16:00:36.679291 16774 ts_tablet_manager.cc:1428] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260808 16:00:36.679275 16776 consensus_queue.cc:260] T 5d5e32e76a7648bcbb46fd529335930f P 8709434d147b4c898aef4d374c29ec4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340a00a0edd471bba2d28ab9d013f1d" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45605 } } peers { permanent_uuid: "8709434d147b4c898aef4d374c29ec4d" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 35683 } } peers { permanent_uuid: "66d4fa5a28b54ed9b41be8bc94e60c58" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37427 } }
I20260808 16:00:36.679939 16321 heartbeater.cc:503] Master 127.19.93.62:33875 was elected leader, sending a full tablet report...
I20260808 16:00:36.680272 16776 ts_tablet_manager.cc:1428] T 5d5e32e76a7648bcbb46fd529335930f P 8709434d147b4c898aef4d374c29ec4d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 16:00:36.681370 16777 raft_consensus.cc:348] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340a00a0edd471bba2d28ab9d013f1d" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45605 } } peers { permanent_uuid: "8709434d147b4c898aef4d374c29ec4d" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 35683 } } peers { permanent_uuid: "66d4fa5a28b54ed9b41be8bc94e60c58" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37427 } }
I20260808 16:00:36.681627 16777 raft_consensus.cc:374] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:36.681687 16777 raft_consensus.cc:729] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5340a00a0edd471bba2d28ab9d013f1d, State: Initialized, Role: FOLLOWER
I20260808 16:00:36.682137 16777 consensus_queue.cc:260] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340a00a0edd471bba2d28ab9d013f1d" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45605 } } peers { permanent_uuid: "8709434d147b4c898aef4d374c29ec4d" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 35683 } } peers { permanent_uuid: "66d4fa5a28b54ed9b41be8bc94e60c58" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37427 } }
I20260808 16:00:36.682694 16534 heartbeater.cc:503] Master 127.19.93.62:33875 was elected leader, sending a full tablet report...
I20260808 16:00:36.683000 16777 ts_tablet_manager.cc:1428] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260808 16:00:36.741472 16323 tablet.cc:2369] T 5d5e32e76a7648bcbb46fd529335930f P 8709434d147b4c898aef4d374c29ec4d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 16:00:36.861137 16743 tablet.cc:2369] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 16:00:36.909030 16785 raft_consensus.cc:482] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 16:00:36.909227 16785 raft_consensus.cc:504] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340a00a0edd471bba2d28ab9d013f1d" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45605 } } peers { permanent_uuid: "8709434d147b4c898aef4d374c29ec4d" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 35683 } } peers { permanent_uuid: "66d4fa5a28b54ed9b41be8bc94e60c58" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37427 } }
I20260808 16:00:36.910333 16785 leader_election.cc:288] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8709434d147b4c898aef4d374c29ec4d (127.19.93.1:35683), 66d4fa5a28b54ed9b41be8bc94e60c58 (127.19.93.3:37427)
I20260808 16:00:36.913743 16541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.910543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:35683 (local address 127.19.93.2:50601)
0808 16:00:36.910670 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:36.910686 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:36.910783 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:36.911118 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:36.911121 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:36.911139 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:36.911239 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:36.911244 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.911955 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.911959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:36.912759 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:36.912768 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.913356 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.913359 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:36.913455 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.913477 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 16:00:36.913541 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 16:00:36.913610 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 16:00:36.913743 16771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.910766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:50601 (local address 127.19.93.1:35683)
0808 16:00:36.910919 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:36.910922 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:36.910934 (+ 12us) server_negotiation.cc:407] Connection header received
0808 16:00:36.910980 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:36.910982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:36.911021 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:36.911084 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:36.911351 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.911846 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.912885 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.913253 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.913344 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.913415 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:36.913570 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 16:00:36.913635 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 16:00:36.913949 16773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.910711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:52161 (local address 127.19.93.3:37427)
0808 16:00:36.910833 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:36.910838 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:36.911047 (+ 209us) server_negotiation.cc:407] Connection header received
0808 16:00:36.911194 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:36.911196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:36.911236 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:36.911298 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:36.911571 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.912036 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.913056 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.913457 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.913557 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.913614 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:36.913779 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 16:00:36.913841 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 16:00:36.913965 16786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.910599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:37427 (local address 127.19.93.2:52161)
0808 16:00:36.910963 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:36.910974 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:36.911090 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:36.911336 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:36.911339 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:36.911357 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:36.911468 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:36.911473 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.912189 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.912193 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:36.912933 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:36.912941 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.913569 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.913573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:36.913667 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.913688 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 16:00:36.913752 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 16:00:36.913816 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":108,"threads_started":1}
I20260808 16:00:36.914419 16250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d5e32e76a7648bcbb46fd529335930f" candidate_uuid: "5340a00a0edd471bba2d28ab9d013f1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8709434d147b4c898aef4d374c29ec4d" is_pre_election: true
I20260808 16:00:36.914582 16669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d5e32e76a7648bcbb46fd529335930f" candidate_uuid: "5340a00a0edd471bba2d28ab9d013f1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d4fa5a28b54ed9b41be8bc94e60c58" is_pre_election: true
I20260808 16:00:36.914759 16250 raft_consensus.cc:2454] T 5d5e32e76a7648bcbb46fd529335930f P 8709434d147b4c898aef4d374c29ec4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5340a00a0edd471bba2d28ab9d013f1d in term 0.
I20260808 16:00:36.914813 16669 raft_consensus.cc:2454] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5340a00a0edd471bba2d28ab9d013f1d in term 0.
I20260808 16:00:36.915252 16353 leader_election.cc:302] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5340a00a0edd471bba2d28ab9d013f1d, 66d4fa5a28b54ed9b41be8bc94e60c58; no voters:
I20260808 16:00:36.915531 16785 raft_consensus.cc:2781] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 16:00:36.915619 16785 raft_consensus.cc:482] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 16:00:36.915669 16785 raft_consensus.cc:3037] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:36.916702 16785 raft_consensus.cc:504] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340a00a0edd471bba2d28ab9d013f1d" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45605 } } peers { permanent_uuid: "8709434d147b4c898aef4d374c29ec4d" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 35683 } } peers { permanent_uuid: "66d4fa5a28b54ed9b41be8bc94e60c58" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37427 } }
I20260808 16:00:36.917001 16785 leader_election.cc:288] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [CANDIDATE]: Term 1 election: Requested vote from peers 8709434d147b4c898aef4d374c29ec4d (127.19.93.1:35683), 66d4fa5a28b54ed9b41be8bc94e60c58 (127.19.93.3:37427)
I20260808 16:00:36.917336 16250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d5e32e76a7648bcbb46fd529335930f" candidate_uuid: "5340a00a0edd471bba2d28ab9d013f1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8709434d147b4c898aef4d374c29ec4d"
I20260808 16:00:36.917359 16669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d5e32e76a7648bcbb46fd529335930f" candidate_uuid: "5340a00a0edd471bba2d28ab9d013f1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d4fa5a28b54ed9b41be8bc94e60c58"
I20260808 16:00:36.917490 16669 raft_consensus.cc:3037] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:36.917490 16250 raft_consensus.cc:3037] T 5d5e32e76a7648bcbb46fd529335930f P 8709434d147b4c898aef4d374c29ec4d [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:36.918692 16250 raft_consensus.cc:2454] T 5d5e32e76a7648bcbb46fd529335930f P 8709434d147b4c898aef4d374c29ec4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5340a00a0edd471bba2d28ab9d013f1d in term 1.
I20260808 16:00:36.918692 16669 raft_consensus.cc:2454] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5340a00a0edd471bba2d28ab9d013f1d in term 1.
I20260808 16:00:36.918983 16352 leader_election.cc:302] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5340a00a0edd471bba2d28ab9d013f1d, 8709434d147b4c898aef4d374c29ec4d; no voters:
I20260808 16:00:36.919137 16785 raft_consensus.cc:2781] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:36.919354 16785 raft_consensus.cc:686] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [term 1 LEADER]: Becoming Leader. State: Replica: 5340a00a0edd471bba2d28ab9d013f1d, State: Running, Role: LEADER
I20260808 16:00:36.919670 16785 consensus_queue.cc:237] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340a00a0edd471bba2d28ab9d013f1d" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45605 } } peers { permanent_uuid: "8709434d147b4c898aef4d374c29ec4d" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 35683 } } peers { permanent_uuid: "66d4fa5a28b54ed9b41be8bc94e60c58" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37427 } }
I20260808 16:00:36.922861 16020 catalog_manager.cc:5495] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5340a00a0edd471bba2d28ab9d013f1d (127.19.93.2). New cstate: current_term: 1 leader_uuid: "5340a00a0edd471bba2d28ab9d013f1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340a00a0edd471bba2d28ab9d013f1d" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8709434d147b4c898aef4d374c29ec4d" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 35683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d4fa5a28b54ed9b41be8bc94e60c58" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37427 } health_report { overall_health: UNKNOWN } } }
W20260808 16:00:36.923889 16536 tablet.cc:2369] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 16:00:36.945782 16768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.942795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56934 (local address 127.19.93.2:45605)
0808 16:00:36.942912 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:36.942915 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:36.942926 (+ 11us) server_negotiation.cc:407] Connection header received
0808 16:00:36.942985 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:36.942987 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:36.943034 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:36.943111 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 16:00:36.943286 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.943747 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.944559 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:36.944778 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:36.944885 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:36.945115 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 16:00:36.945499 (+ 384us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 16:00:36.945588 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:36.945616 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 16:00:36.945660 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 16:00:36.950920 16669 raft_consensus.cc:1261] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58 [term 1 FOLLOWER]: Refusing update from remote peer 5340a00a0edd471bba2d28ab9d013f1d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 16:00:36.950922 16250 raft_consensus.cc:1261] T 5d5e32e76a7648bcbb46fd529335930f P 8709434d147b4c898aef4d374c29ec4d [term 1 FOLLOWER]: Refusing update from remote peer 5340a00a0edd471bba2d28ab9d013f1d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 16:00:36.951581 16787 consensus_queue.cc:1035] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d4fa5a28b54ed9b41be8bc94e60c58" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 16:00:36.951748 16785 consensus_queue.cc:1035] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8709434d147b4c898aef4d374c29ec4d" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 35683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 16:00:36.958711 16792 mvcc.cc:205] Tried to move back new op lower bound from 7316295012144795648 to 7316295012025688064. Current Snapshot: MvccSnapshot[applied={T|T < 7316295012144795648}]
I20260808 16:00:36.966769 16020 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 16:00:36.966948 16020 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 16:00:36.969362 16020 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0cb166594edd4cc28dc4f511d94c8ff5: Sending DeleteTablet for 3 replicas of tablet 5d5e32e76a7648bcbb46fd529335930f
I20260808 16:00:36.970093 16222 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d5e32e76a7648bcbb46fd529335930f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:36 UTC) from {username='slave'} at 127.0.0.1:41348
I20260808 16:00:36.970139 16432 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d5e32e76a7648bcbb46fd529335930f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:36 UTC) from {username='slave'} at 127.0.0.1:56932
I20260808 16:00:36.970139 16643 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d5e32e76a7648bcbb46fd529335930f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:36 UTC) from {username='slave'} at 127.0.0.1:45584
I20260808 16:00:36.970582 16807 tablet_replica.cc:330] T 5d5e32e76a7648bcbb46fd529335930f P 8709434d147b4c898aef4d374c29ec4d: stopping tablet replica
I20260808 16:00:36.970757 16809 tablet_replica.cc:330] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58: stopping tablet replica
I20260808 16:00:36.970860 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 16123
I20260808 16:00:36.971812 16809 raft_consensus.cc:2229] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 16:00:36.972103 16809 raft_consensus.cc:2258] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 16:00:36.977774 16809 ts_tablet_manager.cc:1905] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 16:00:36.979563 16808 tablet_replica.cc:330] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d: stopping tablet replica
I20260808 16:00:36.979899 16808 raft_consensus.cc:2229] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [term 1 LEADER]: Raft consensus shutting down.
I20260808 16:00:36.980405 16808 raft_consensus.cc:2258] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 16:00:36.980651 16809 ts_tablet_manager.cc:1918] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 16:00:36.980806 16809 log.cc:1196] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/5d5e32e76a7648bcbb46fd529335930f
I20260808 16:00:36.981197 16809 ts_tablet_manager.cc:1939] T 5d5e32e76a7648bcbb46fd529335930f P 66d4fa5a28b54ed9b41be8bc94e60c58: Deleting consensus metadata
I20260808 16:00:36.981911 16808 ts_tablet_manager.cc:1905] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 16:00:36.982502 15995 catalog_manager.cc:4841] TS 66d4fa5a28b54ed9b41be8bc94e60c58 (127.19.93.3:37427): tablet 5d5e32e76a7648bcbb46fd529335930f (table test-table [id=99c8aeb2d3f34efda93b5b88b335f582]) successfully deleted
I20260808 16:00:36.984629 16808 ts_tablet_manager.cc:1918] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 16:00:36.984727 16808 log.cc:1196] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/5d5e32e76a7648bcbb46fd529335930f
I20260808 16:00:36.985033 16808 ts_tablet_manager.cc:1939] T 5d5e32e76a7648bcbb46fd529335930f P 5340a00a0edd471bba2d28ab9d013f1d: Deleting consensus metadata
W20260808 16:00:36.985240 15994 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:35683 (error 108)
I20260808 16:00:36.986162 15996 catalog_manager.cc:4841] TS 5340a00a0edd471bba2d28ab9d013f1d (127.19.93.2:45605): tablet 5d5e32e76a7648bcbb46fd529335930f (table test-table [id=99c8aeb2d3f34efda93b5b88b335f582]) successfully deleted
I20260808 16:00:36.986320 16772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:36.985996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:35683 (local address 127.0.0.1:41358)
0808 16:00:36.986173 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:36.986242 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:35683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
W20260808 16:00:36.986469 15994 catalog_manager.cc:4584] TS 8709434d147b4c898aef4d374c29ec4d (127.19.93.1:35683): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5d5e32e76a7648bcbb46fd529335930f: Network error: Client connection negotiation failed: client connection to 127.19.93.1:35683: connect: Connection refused (error 111)
I20260808 16:00:36.986867 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 16325
I20260808 16:00:37.000597 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 16542
I20260808 16:00:37.016278 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 15972
2026-08-08T16:00:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1203 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:00:37 dist-test-slave-lgr5 krb5kdc[16817](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:00:37 dist-test-slave-lgr5 krb5kdc[16817](info): set up 2 sockets
Aug 08 16:00:37 dist-test-slave-lgr5 krb5kdc[16817](info): commencing operation
krb5kdc: starting...
W20260808 16:00:38.163928 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:00:38 dist-test-slave-lgr5 krb5kdc[16817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:00:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:00:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 16:00:38.276682 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:35931
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:40861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:35931
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:38.384380 16840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:38.384604 16840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:38.384644 16840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:38.388545 16840 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:38.388594 16840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:38.388615 16840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:38.388648 16840 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:38.388679 16840 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:38.394125 16840 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:40861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:35931
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:35931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16840
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:38.395040 16840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:38.396040 16840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:38.403896 16849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:38.403935 16852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:38.403931 16850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:38.404258 16840 server_base.cc:1034] running on GCE node
I20260808 16:00:38.404780 16840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:38.405766 16840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:38.406929 16840 hybrid_clock.cc:648] HybridClock initialized: now 1786204838406916 us; error 32 us; skew 500 ppm
Aug 08 16:00:38 dist-test-slave-lgr5 krb5kdc[16817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204838, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:38.409471 16840 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 16:00:38.410259 16840 webserver.cc:460] Webserver started at http://127.19.93.62:42027/ using document root <none> and password file <none>
I20260808 16:00:38.410749 16840 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:38.410812 16840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:38.411010 16840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:38.412938 16840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "a191b323825e4d5da1c5bdf37e50d6a6"
format_stamp: "Formatted at 2026-08-08 16:00:38 on dist-test-slave-lgr5"
server_key: "345f3e4573b80f322d2e23f08bb76f07"
server_key_iv: "f8ed267def518d4be56dbb15323c48fb"
server_key_version: "encryptionkey@0"
I20260808 16:00:38.413443 16840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "a191b323825e4d5da1c5bdf37e50d6a6"
format_stamp: "Formatted at 2026-08-08 16:00:38 on dist-test-slave-lgr5"
server_key: "345f3e4573b80f322d2e23f08bb76f07"
server_key_iv: "f8ed267def518d4be56dbb15323c48fb"
server_key_version: "encryptionkey@0"
I20260808 16:00:38.416865 16840 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 16:00:38.419064 16864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:38.420176 16840 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:38.420284 16840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "a191b323825e4d5da1c5bdf37e50d6a6"
format_stamp: "Formatted at 2026-08-08 16:00:38 on dist-test-slave-lgr5"
server_key: "345f3e4573b80f322d2e23f08bb76f07"
server_key_iv: "f8ed267def518d4be56dbb15323c48fb"
server_key_version: "encryptionkey@0"
I20260808 16:00:38.420372 16840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:38.435956 16840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:38.438313 16840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:38.438486 16840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:38.444629 16840 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:35931
I20260808 16:00:38.444679 16952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:35931 every 8 connection(s)
I20260808 16:00:38.445451 16840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:38.447913 16953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:38.452064 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 16840
I20260808 16:00:38.452222 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:00:38.452512 19828 external_mini_cluster.cc:1428] Setting key 1e75146f59922518070409daa19d452d
I20260808 16:00:38.453717 16953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6: Bootstrap starting.
I20260808 16:00:38.455957 16953 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:38.456743 16953 log.cc:824] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:38.458421 16953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6: No bootstrap required, opened a new log
Aug 08 16:00:38 dist-test-slave-lgr5 krb5kdc[16817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:00:38.462292 16953 raft_consensus.cc:348] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a191b323825e4d5da1c5bdf37e50d6a6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35931 } }
I20260808 16:00:38.462517 16953 raft_consensus.cc:374] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:38.462554 16953 raft_consensus.cc:729] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a191b323825e4d5da1c5bdf37e50d6a6, State: Initialized, Role: FOLLOWER
I20260808 16:00:38.462960 16953 consensus_queue.cc:260] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a191b323825e4d5da1c5bdf37e50d6a6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35931 } }
I20260808 16:00:38.463085 16953 raft_consensus.cc:388] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:38.463142 16953 raft_consensus.cc:482] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:38.463238 16953 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:38.464260 16953 raft_consensus.cc:504] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a191b323825e4d5da1c5bdf37e50d6a6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35931 } }
I20260808 16:00:38.464614 16953 leader_election.cc:302] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a191b323825e4d5da1c5bdf37e50d6a6; no voters:
I20260808 16:00:38.464958 16953 leader_election.cc:288] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:00:38.465044 16963 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:38.465315 16963 raft_consensus.cc:686] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [term 1 LEADER]: Becoming Leader. State: Replica: a191b323825e4d5da1c5bdf37e50d6a6, State: Running, Role: LEADER
I20260808 16:00:38.465670 16963 consensus_queue.cc:237] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a191b323825e4d5da1c5bdf37e50d6a6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35931 } }
I20260808 16:00:38.466111 16960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:38.453747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55738 (local address 127.19.93.62:35931)
0808 16:00:38.454119 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:38.454133 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:38.454166 (+ 33us) server_negotiation.cc:407] Connection header received
0808 16:00:38.454758 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:38.454773 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:38.455089 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:38.455341 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:38.456254 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:38.457223 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:38.458071 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:38.458518 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:38.458669 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:38.461421 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:38.461426 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:38.461439 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:38.461465 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:38.463077 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:38.463591 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:38.463595 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:38.463600 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:38.463708 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:38.463984 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:38.463986 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:38.463987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:38.464417 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:38.464558 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:38.464894 (+ 336us) server_negotiation.cc:299] Negotiation successful
0808 16:00:38.465183 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":107,"threads_started":1}
I20260808 16:00:38.466218 16953 sys_catalog.cc:564] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:38.467975 16965 sys_catalog.cc:455] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a191b323825e4d5da1c5bdf37e50d6a6. Latest consensus state: current_term: 1 leader_uuid: "a191b323825e4d5da1c5bdf37e50d6a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a191b323825e4d5da1c5bdf37e50d6a6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35931 } } }
I20260808 16:00:38.468116 16965 sys_catalog.cc:458] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:38.468426 16964 sys_catalog.cc:455] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a191b323825e4d5da1c5bdf37e50d6a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a191b323825e4d5da1c5bdf37e50d6a6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35931 } } }
I20260808 16:00:38.469089 16964 sys_catalog.cc:458] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6 [sys.catalog]: This master's current role is: LEADER
W20260808 16:00:38.470655 16987 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 16:00:38.470719 16987 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 16:00:38.470831 16988 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:38.471746 16988 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:38.476848 16988 catalog_manager.cc:1347] Generated new cluster ID: 9b5aae2c69aa49a0981c47f86a2b2995
I20260808 16:00:38.476910 16988 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:38.485332 16988 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:00:38.486168 16988 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:38.491866 16988 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6: Generated new TSK 0
I20260808 16:00:38.492501 16988 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 16:00:38.522565 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:35931
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:40861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:38.647039 16997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:38.647291 16997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:38.647370 16997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:38.651340 16997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:38.651397 16997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:38.651453 16997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 16:00:38.656461 16997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:40861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:35931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:38.657354 16997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:38.658329 16997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:38.667500 17009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:38.667510 17007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:38.667510 17005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:38.667726 16997 server_base.cc:1034] running on GCE node
I20260808 16:00:38.668216 16997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:38.668829 16997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:38.669991 16997 hybrid_clock.cc:648] HybridClock initialized: now 1786204838669967 us; error 36 us; skew 500 ppm
Aug 08 16:00:38 dist-test-slave-lgr5 krb5kdc[16817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204838, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:38.672676 16997 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 16:00:38.673466 16997 webserver.cc:460] Webserver started at http://127.19.93.1:45821/ using document root <none> and password file <none>
I20260808 16:00:38.673964 16997 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:38.674021 16997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:38.674186 16997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:38.676105 16997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "ad878c4b8fd1446f8f6db5bfae345b5b"
format_stamp: "Formatted at 2026-08-08 16:00:38 on dist-test-slave-lgr5"
server_key: "6f8566be4cd666adfc39287affc73517"
server_key_iv: "bae8e9adb92f2bf1df92039edf6de8a3"
server_key_version: "encryptionkey@0"
I20260808 16:00:38.676613 16997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "ad878c4b8fd1446f8f6db5bfae345b5b"
format_stamp: "Formatted at 2026-08-08 16:00:38 on dist-test-slave-lgr5"
server_key: "6f8566be4cd666adfc39287affc73517"
server_key_iv: "bae8e9adb92f2bf1df92039edf6de8a3"
server_key_version: "encryptionkey@0"
I20260808 16:00:38.680255 16997 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 16:00:38.682559 17017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:38.683696 16997 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:00:38.683792 16997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "ad878c4b8fd1446f8f6db5bfae345b5b"
format_stamp: "Formatted at 2026-08-08 16:00:38 on dist-test-slave-lgr5"
server_key: "6f8566be4cd666adfc39287affc73517"
server_key_iv: "bae8e9adb92f2bf1df92039edf6de8a3"
server_key_version: "encryptionkey@0"
I20260808 16:00:38.683871 16997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:38.695601 16997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:38.698087 16997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:38.698244 16997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:38.698730 16997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:38.699466 16997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:38.699512 16997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:38.699548 16997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:38.699566 16997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:38.707458 16997 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:38017
I20260808 16:00:38.707494 17205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:38017 every 8 connection(s)
I20260808 16:00:38.708298 16997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
Aug 08 16:00:38 dist-test-slave-lgr5 krb5kdc[16817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204838, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:00:38.718477 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 16997
I20260808 16:00:38.718597 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 16:00:38.718873 19828 external_mini_cluster.cc:1428] Setting key 45af4c9466fc4c87d6130250d5ed1f3d
I20260808 16:00:38.720567 16960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:38.709946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:50825 (local address 127.19.93.62:35931)
0808 16:00:38.710082 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:38.710088 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:38.710843 (+ 755us) server_negotiation.cc:407] Connection header received
0808 16:00:38.712029 (+ 1186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:38.712032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:38.712105 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:38.712188 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:38.713219 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:38.713746 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:38.714782 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:38.714994 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:38.715073 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:38.717278 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:38.717281 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:38.717284 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:38.717307 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:38.718420 (+ 1113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:38.718931 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:38.718934 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:38.718935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:38.719024 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:38.719401 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:38.719404 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:38.719406 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:38.719633 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:38.719714 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:38.720285 (+ 571us) server_negotiation.cc:299] Negotiation successful
0808 16:00:38.720416 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 16:00:38.721288 17208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:38.710291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:35931 (local address 127.19.93.1:50825)
0808 16:00:38.710701 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:38.710741 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:38.711852 (+ 1111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:38.712321 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:38.712327 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:38.712661 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:38.713100 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:38.713112 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:38.713833 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:38.713835 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:38.714694 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:38.714703 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:38.715103 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:38.715106 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:38.715243 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:38.715766 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:00:38.715781 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:38.717130 (+ 1349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:38.718532 (+ 1402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:38.718537 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:38.718551 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:38.718835 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:38.719111 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:38.719114 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:38.719117 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:38.719286 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:38.719733 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:38.719738 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:38.720004 (+ 266us) client_negotiation.cc:769] Sending connection context
0808 16:00:38.720235 (+ 231us) client_negotiation.cc:240] Negotiation successful
0808 16:00:38.720507 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":109,"threads_started":1}
I20260808 16:00:38.722360 17206 heartbeater.cc:347] Connected to a master server at 127.19.93.62:35931
I20260808 16:00:38.722589 17206 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:38.723019 17206 heartbeater.cc:511] Master 127.19.93.62:35931 requested a full tablet report, sending...
I20260808 16:00:38.724459 16895 ts_manager.cc:194] Registered new tserver with Master: ad878c4b8fd1446f8f6db5bfae345b5b (127.19.93.1:38017)
I20260808 16:00:38.725630 16895 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:50825
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 16:00:38.744560 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:35931
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:40861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:38.849668 17212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:38.849882 17212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:38.849938 17212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:38.853812 17212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:38.853863 17212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:38.853937 17212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 16:00:38.858847 17212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:40861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:35931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:38.859715 17212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:38.860639 17212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:38.869532 17219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:38.869653 17212 server_base.cc:1034] running on GCE node
W20260808 16:00:38.869539 17221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:38.869558 17223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:38.870230 17212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:38.870748 17212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:38.871908 17212 hybrid_clock.cc:648] HybridClock initialized: now 1786204838871896 us; error 23 us; skew 500 ppm
Aug 08 16:00:38 dist-test-slave-lgr5 krb5kdc[16817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204838, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:38.874444 17212 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 16:00:38.875244 17212 webserver.cc:460] Webserver started at http://127.19.93.2:40769/ using document root <none> and password file <none>
I20260808 16:00:38.875730 17212 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:38.875792 17212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:38.875980 17212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:38.877836 17212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "daa96db3434849218a99abdfccd6ea4b"
format_stamp: "Formatted at 2026-08-08 16:00:38 on dist-test-slave-lgr5"
server_key: "390e0549acafc768b8878bb0d1694221"
server_key_iv: "14999664ff2606590bee32d6d7aa38ad"
server_key_version: "encryptionkey@0"
I20260808 16:00:38.878350 17212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "daa96db3434849218a99abdfccd6ea4b"
format_stamp: "Formatted at 2026-08-08 16:00:38 on dist-test-slave-lgr5"
server_key: "390e0549acafc768b8878bb0d1694221"
server_key_iv: "14999664ff2606590bee32d6d7aa38ad"
server_key_version: "encryptionkey@0"
I20260808 16:00:38.881847 17212 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 16:00:38.883905 17232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:38.885001 17212 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:00:38.885113 17212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "daa96db3434849218a99abdfccd6ea4b"
format_stamp: "Formatted at 2026-08-08 16:00:38 on dist-test-slave-lgr5"
server_key: "390e0549acafc768b8878bb0d1694221"
server_key_iv: "14999664ff2606590bee32d6d7aa38ad"
server_key_version: "encryptionkey@0"
I20260808 16:00:38.885198 17212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:38.901870 17212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:38.904666 17212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:38.904827 17212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:38.905328 17212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:38.906067 17212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:38.906113 17212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:38.906162 17212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:38.906191 17212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:38.914178 17212 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:40741
I20260808 16:00:38.914206 17421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:40741 every 8 connection(s)
I20260808 16:00:38.914958 17212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 16:00:38.919787 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 17212
I20260808 16:00:38.919929 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 16:00:38.920254 19828 external_mini_cluster.cc:1428] Setting key 13242f638685ed4292ada19afb43680b
Aug 08 16:00:38 dist-test-slave-lgr5 krb5kdc[16817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204838, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:00:38.927892 16960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:38.916534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:49511 (local address 127.19.93.62:35931)
0808 16:00:38.916650 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:38.916654 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:38.917388 (+ 734us) server_negotiation.cc:407] Connection header received
0808 16:00:38.918630 (+ 1242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:38.918633 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:38.918691 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:38.918760 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:38.919948 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:38.920575 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:38.921929 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:38.922150 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:38.922222 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:38.924741 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:38.924744 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:38.924746 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:38.924769 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:38.925985 (+ 1216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:38.926505 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:38.926508 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:38.926509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:38.926583 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:38.926889 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:38.926892 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:38.926894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:38.927069 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:38.927153 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:38.927614 (+ 461us) server_negotiation.cc:299] Negotiation successful
0808 16:00:38.927737 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 16:00:38.928633 17426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:38.916827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:35931 (local address 127.19.93.2:49511)
0808 16:00:38.917249 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:38.917287 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:38.918405 (+ 1118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:38.918927 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:38.918933 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:38.919255 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:38.919783 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:38.919805 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:38.920703 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:38.920706 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:38.921799 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:38.921812 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:38.922288 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:38.922292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:38.922464 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:38.922988 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:00:38.923008 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:38.924597 (+ 1589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:38.926091 (+ 1494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:38.926097 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:38.926109 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:38.926413 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:38.926665 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:38.926668 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:38.926670 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:38.926800 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:38.927167 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:38.927173 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:38.927394 (+ 221us) client_negotiation.cc:769] Sending connection context
0808 16:00:38.927550 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 16:00:38.927834 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":110,"threads_started":1}
I20260808 16:00:38.929651 17422 heartbeater.cc:347] Connected to a master server at 127.19.93.62:35931
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
I20260808 16:00:38.929853 17422 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:38.930277 17422 heartbeater.cc:511] Master 127.19.93.62:35931 requested a full tablet report, sending...
I20260808 16:00:38.931268 16895 ts_manager.cc:194] Registered new tserver with Master: daa96db3434849218a99abdfccd6ea4b (127.19.93.2:40741)
I20260808 16:00:38.931865 16895 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:49511
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 16:00:38.944813 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:35931
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:40861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:39.053784 17431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:39.054023 17431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:39.054078 17431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:39.057997 17431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:39.058046 17431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:39.058120 17431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 16:00:39.063112 17431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:40861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:35931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:39.064073 17431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:39.065057 17431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:39.074133 17442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:39.074144 17437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:39.074146 17438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:39.074237 17431 server_base.cc:1034] running on GCE node
I20260808 16:00:39.074738 17431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:39.075367 17431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:39.076538 17431 hybrid_clock.cc:648] HybridClock initialized: now 1786204839076521 us; error 29 us; skew 500 ppm
Aug 08 16:00:39 dist-test-slave-lgr5 krb5kdc[16817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204839, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:39.079083 17431 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 16:00:39.079903 17431 webserver.cc:460] Webserver started at http://127.19.93.3:33179/ using document root <none> and password file <none>
I20260808 16:00:39.080447 17431 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:39.080513 17431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:39.080703 17431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:39.082579 17431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "f1c9db6fb1cf4a1d815ff28462a4d0cf"
format_stamp: "Formatted at 2026-08-08 16:00:39 on dist-test-slave-lgr5"
server_key: "5871413a106f030a9aaaf6592fa5cf09"
server_key_iv: "faac9d2deb5842172ba18e52660ada3c"
server_key_version: "encryptionkey@0"
I20260808 16:00:39.083096 17431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "f1c9db6fb1cf4a1d815ff28462a4d0cf"
format_stamp: "Formatted at 2026-08-08 16:00:39 on dist-test-slave-lgr5"
server_key: "5871413a106f030a9aaaf6592fa5cf09"
server_key_iv: "faac9d2deb5842172ba18e52660ada3c"
server_key_version: "encryptionkey@0"
I20260808 16:00:39.086479 17431 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 16:00:39.088769 17452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:39.089903 17431 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 16:00:39.090011 17431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "f1c9db6fb1cf4a1d815ff28462a4d0cf"
format_stamp: "Formatted at 2026-08-08 16:00:39 on dist-test-slave-lgr5"
server_key: "5871413a106f030a9aaaf6592fa5cf09"
server_key_iv: "faac9d2deb5842172ba18e52660ada3c"
server_key_version: "encryptionkey@0"
I20260808 16:00:39.090096 17431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:39.116431 17431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:39.119273 17431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:39.119441 17431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:39.119987 17431 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:39.120769 17431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:39.120816 17431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:39.120868 17431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:39.120901 17431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:39.129102 17431 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:33535
I20260808 16:00:39.129155 17632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:33535 every 8 connection(s)
I20260808 16:00:39.129921 17431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 16:00:39.130365 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 17431
I20260808 16:00:39.130486 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 16:00:39.130795 19828 external_mini_cluster.cc:1428] Setting key 725b6b103a452920b080dc73058fe523
Aug 08 16:00:39 dist-test-slave-lgr5 krb5kdc[16817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204839, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:00:39.142221 16960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.131624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:34303 (local address 127.19.93.62:35931)
0808 16:00:39.131779 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:39.131783 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:39.132722 (+ 939us) server_negotiation.cc:407] Connection header received
0808 16:00:39.134008 (+ 1286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:39.134012 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:39.134067 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:39.134138 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:39.135247 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.135760 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.136894 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.137105 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.137192 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.139438 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:39.139441 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:39.139443 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:39.139467 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:39.140650 (+ 1183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:39.141088 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:39.141090 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:39.141091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:39.141156 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:39.141393 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:39.141395 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:39.141396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:39.141558 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:39.141626 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:39.142016 (+ 390us) server_negotiation.cc:299] Negotiation successful
0808 16:00:39.142107 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 16:00:39.142925 17638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.132110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:35931 (local address 127.19.93.3:34303)
0808 16:00:39.132592 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:39.132632 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:39.133818 (+ 1186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:39.134317 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:39.134324 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:39.134659 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:39.135116 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:39.135130 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.135873 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.135877 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:39.136776 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:39.136786 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.137240 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.137244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:39.137407 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.137903 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:00:39.137918 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:39.139295 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:39.140756 (+ 1461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:39.140760 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:39.140770 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:39.141016 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:39.141215 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:39.141217 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:39.141218 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:39.141332 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:39.141623 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:39.141627 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:39.141831 (+ 204us) client_negotiation.cc:769] Sending connection context
0808 16:00:39.141985 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 16:00:39.142206 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":146,"threads_started":1}
I20260808 16:00:39.144106 17634 heartbeater.cc:347] Connected to a master server at 127.19.93.62:35931
I20260808 16:00:39.144340 17634 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:39.144834 17634 heartbeater.cc:511] Master 127.19.93.62:35931 requested a full tablet report, sending...
I20260808 16:00:39.145887 16894 ts_manager.cc:194] Registered new tserver with Master: f1c9db6fb1cf4a1d815ff28462a4d0cf (127.19.93.3:33535)
I20260808 16:00:39.146432 16894 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:34303
I20260808 16:00:39.156248 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 16:00:39.165143 16960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.158128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55742 (local address 127.19.93.62:35931)
0808 16:00:39.158261 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:39.158265 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:39.158409 (+ 144us) server_negotiation.cc:407] Connection header received
0808 16:00:39.158532 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:39.158536 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:39.158584 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:39.158647 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:39.159326 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.159828 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.160679 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.160890 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.160974 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.162391 (+ 1417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:39.162395 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:39.162397 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:39.162420 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:39.163408 (+ 988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:39.163882 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:39.163885 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:39.163887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:39.163963 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:39.164312 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:39.164315 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:39.164316 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:39.164508 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:39.164649 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:39.164915 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 16:00:39.165005 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 16:00:39.167851 16894 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55742:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 16:00:39.170807 16894 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 16:00:39.184052 17653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.178593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:33535 (local address 127.0.0.1:43660)
0808 16:00:39.179603 (+ 1010us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:39.179613 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:39.179690 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:39.180372 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:39.180378 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:39.180404 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:39.180552 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:39.180560 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.181627 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.181630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:39.182768 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:39.182778 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.183553 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.183556 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:39.183663 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.183700 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 16:00:39.183795 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 16:00:39.183910 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":953,"mutex_wait_us":3,"thread_start_us":94,"threads_started":1}
I20260808 16:00:39.184069 17657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.179230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43660 (local address 127.19.93.3:33535)
0808 16:00:39.179866 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:39.179878 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:39.179902 (+ 24us) server_negotiation.cc:407] Connection header received
0808 16:00:39.179971 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:39.179976 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:39.180200 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:39.180703 (+ 503us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:39.180823 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.181503 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.182882 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.183432 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.183528 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.183672 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:39.183834 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 16:00:39.183922 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":127,"threads_started":1}
I20260808 16:00:39.184563 17655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.178465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:38017 (local address 127.0.0.1:53886)
0808 16:00:39.179233 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:39.179278 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:39.179400 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:39.180421 (+ 1021us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:39.180423 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:39.180437 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:39.180558 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:39.180564 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.181964 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.181967 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:39.183104 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:39.183114 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.184202 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.184206 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:39.184293 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.184318 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 16:00:39.184366 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 16:00:39.184432 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"mutex_wait_us":23,"thread_start_us":90,"threads_started":1}
I20260808 16:00:39.185199 17654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.178600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53886 (local address 127.19.93.1:38017)
0808 16:00:39.179937 (+ 1337us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:39.179948 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:39.179971 (+ 23us) server_negotiation.cc:407] Connection header received
0808 16:00:39.180040 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:39.180044 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:39.180267 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:39.180453 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:39.180667 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.181804 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.183248 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.184036 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.184817 (+ 781us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.184955 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:39.184997 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 16:00:39.185073 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1225,"thread_start_us":110,"threads_started":1}
I20260808 16:00:39.185197 17656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.179222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34390 (local address 127.19.93.2:40741)
0808 16:00:39.179668 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:39.179681 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:39.180411 (+ 730us) server_negotiation.cc:407] Connection header received
0808 16:00:39.180485 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:39.180490 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:39.180656 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:39.180792 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:39.181181 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.182402 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.183747 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.184561 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.184668 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.184806 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:39.184972 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 16:00:39.185054 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":99,"threads_started":1}
I20260808 16:00:39.185377 17652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.178825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:40741 (local address 127.0.0.1:34390)
0808 16:00:39.180220 (+ 1395us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:39.180234 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:39.180313 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:39.180947 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:39.180951 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:39.180969 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:39.181060 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:39.181067 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.182540 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.182544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:39.183619 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:39.183629 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.184736 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.184739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:39.184834 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.184858 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 16:00:39.184932 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 16:00:39.184995 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1336,"thread_start_us":88,"threads_started":1}
I20260808 16:00:39.187594 17524 tablet_service.cc:1467] Processing CreateTablet for tablet 6bec0e15a9204612ad034283f0af881e (DEFAULT_TABLE table=test-table [id=54a55e23069549f683680e40a0a45abf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:39.187850 17316 tablet_service.cc:1467] Processing CreateTablet for tablet 6bec0e15a9204612ad034283f0af881e (DEFAULT_TABLE table=test-table [id=54a55e23069549f683680e40a0a45abf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:39.188064 17099 tablet_service.cc:1467] Processing CreateTablet for tablet 6bec0e15a9204612ad034283f0af881e (DEFAULT_TABLE table=test-table [id=54a55e23069549f683680e40a0a45abf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:39.188802 17524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bec0e15a9204612ad034283f0af881e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:39.188825 17316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bec0e15a9204612ad034283f0af881e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:39.189051 17099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bec0e15a9204612ad034283f0af881e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:39.196195 17658 tablet_bootstrap.cc:492] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b: Bootstrap starting.
I20260808 16:00:39.198621 17658 tablet_bootstrap.cc:654] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:39.200222 17659 tablet_bootstrap.cc:492] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf: Bootstrap starting.
I20260808 16:00:39.202507 17659 tablet_bootstrap.cc:654] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:39.203725 17659 log.cc:824] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:39.204612 17658 log.cc:824] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:39.206199 17659 tablet_bootstrap.cc:492] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf: No bootstrap required, opened a new log
I20260808 16:00:39.206411 17659 ts_tablet_manager.cc:1397] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260808 16:00:39.206607 17663 tablet_bootstrap.cc:492] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b: Bootstrap starting.
I20260808 16:00:39.207981 17658 tablet_bootstrap.cc:492] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b: No bootstrap required, opened a new log
I20260808 16:00:39.208236 17658 ts_tablet_manager.cc:1397] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20260808 16:00:39.209187 17663 tablet_bootstrap.cc:654] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:39.209496 17659 raft_consensus.cc:348] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad878c4b8fd1446f8f6db5bfae345b5b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38017 } } peers { permanent_uuid: "f1c9db6fb1cf4a1d815ff28462a4d0cf" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 33535 } } peers { permanent_uuid: "daa96db3434849218a99abdfccd6ea4b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40741 } }
I20260808 16:00:39.209836 17659 raft_consensus.cc:374] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:39.209959 17659 raft_consensus.cc:729] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c9db6fb1cf4a1d815ff28462a4d0cf, State: Initialized, Role: FOLLOWER
I20260808 16:00:39.210018 17663 log.cc:824] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:39.210557 17659 consensus_queue.cc:260] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad878c4b8fd1446f8f6db5bfae345b5b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38017 } } peers { permanent_uuid: "f1c9db6fb1cf4a1d815ff28462a4d0cf" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 33535 } } peers { permanent_uuid: "daa96db3434849218a99abdfccd6ea4b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40741 } }
I20260808 16:00:39.211243 17634 heartbeater.cc:503] Master 127.19.93.62:35931 was elected leader, sending a full tablet report...
I20260808 16:00:39.211563 17659 ts_tablet_manager.cc:1428] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260808 16:00:39.212602 17658 raft_consensus.cc:348] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad878c4b8fd1446f8f6db5bfae345b5b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38017 } } peers { permanent_uuid: "f1c9db6fb1cf4a1d815ff28462a4d0cf" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 33535 } } peers { permanent_uuid: "daa96db3434849218a99abdfccd6ea4b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40741 } }
I20260808 16:00:39.212859 17658 raft_consensus.cc:374] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:39.212911 17658 raft_consensus.cc:729] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad878c4b8fd1446f8f6db5bfae345b5b, State: Initialized, Role: FOLLOWER
I20260808 16:00:39.213326 17658 consensus_queue.cc:260] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad878c4b8fd1446f8f6db5bfae345b5b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38017 } } peers { permanent_uuid: "f1c9db6fb1cf4a1d815ff28462a4d0cf" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 33535 } } peers { permanent_uuid: "daa96db3434849218a99abdfccd6ea4b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40741 } }
I20260808 16:00:39.213567 17663 tablet_bootstrap.cc:492] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b: No bootstrap required, opened a new log
I20260808 16:00:39.213750 17663 ts_tablet_manager.cc:1397] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 16:00:39.214161 17206 heartbeater.cc:503] Master 127.19.93.62:35931 was elected leader, sending a full tablet report...
I20260808 16:00:39.214248 17658 ts_tablet_manager.cc:1428] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 16:00:39.217505 17663 raft_consensus.cc:348] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad878c4b8fd1446f8f6db5bfae345b5b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38017 } } peers { permanent_uuid: "f1c9db6fb1cf4a1d815ff28462a4d0cf" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 33535 } } peers { permanent_uuid: "daa96db3434849218a99abdfccd6ea4b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40741 } }
I20260808 16:00:39.217733 17663 raft_consensus.cc:374] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:39.217801 17663 raft_consensus.cc:729] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daa96db3434849218a99abdfccd6ea4b, State: Initialized, Role: FOLLOWER
I20260808 16:00:39.218194 17663 consensus_queue.cc:260] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad878c4b8fd1446f8f6db5bfae345b5b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38017 } } peers { permanent_uuid: "f1c9db6fb1cf4a1d815ff28462a4d0cf" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 33535 } } peers { permanent_uuid: "daa96db3434849218a99abdfccd6ea4b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40741 } }
I20260808 16:00:39.218837 17422 heartbeater.cc:503] Master 127.19.93.62:35931 was elected leader, sending a full tablet report...
I20260808 16:00:39.219112 17663 ts_tablet_manager.cc:1428] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260808 16:00:39.380875 17637 tablet.cc:2369] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 16:00:39.416028 17425 tablet.cc:2369] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 16:00:39.440017 17672 raft_consensus.cc:482] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 16:00:39.440233 17672 raft_consensus.cc:504] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad878c4b8fd1446f8f6db5bfae345b5b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38017 } } peers { permanent_uuid: "f1c9db6fb1cf4a1d815ff28462a4d0cf" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 33535 } } peers { permanent_uuid: "daa96db3434849218a99abdfccd6ea4b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40741 } }
I20260808 16:00:39.441396 17672 leader_election.cc:288] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c9db6fb1cf4a1d815ff28462a4d0cf (127.19.93.3:33535), daa96db3434849218a99abdfccd6ea4b (127.19.93.2:40741)
I20260808 16:00:39.446254 17656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.441692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:53295 (local address 127.19.93.2:40741)
0808 16:00:39.441817 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:39.441822 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:39.442104 (+ 282us) server_negotiation.cc:407] Connection header received
0808 16:00:39.442252 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:39.442255 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:39.442309 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:39.442391 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:39.442736 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.443514 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.445211 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.445610 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.445673 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.445726 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:39.446049 (+ 323us) server_negotiation.cc:299] Negotiation successful
0808 16:00:39.446127 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 16:00:39.446347 17657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.441692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:41239 (local address 127.19.93.3:33535)
0808 16:00:39.441817 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:39.441822 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:39.442100 (+ 278us) server_negotiation.cc:407] Connection header received
0808 16:00:39.442252 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:39.442255 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:39.442308 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:39.442390 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:39.442737 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.443518 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.445204 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.445823 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.445926 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.445985 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:39.446160 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 16:00:39.446225 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 16:00:39.446547 17675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.441603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:33535 (local address 127.19.93.1:41239)
0808 16:00:39.441984 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:39.441999 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:39.442144 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:39.442408 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:39.442411 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:39.442436 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:39.442639 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:39.442646 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.443631 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.443635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:39.445058 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:39.445070 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.445949 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.445952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:39.446056 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.446076 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 16:00:39.446139 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 16:00:39.446210 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":93,"spinlock_wait_cycles":17920,"thread_start_us":108,"threads_started":1}
I20260808 16:00:39.446600 17674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.441603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:40741 (local address 127.19.93.1:53295)
0808 16:00:39.442009 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:39.442022 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:39.442144 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:39.442408 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:39.442411 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:39.442436 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:39.442622 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:39.442630 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.443631 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.443635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:39.445058 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:39.445070 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.445806 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.445808 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:39.445905 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.445930 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 16:00:39.446395 (+ 465us) client_negotiation.cc:240] Negotiation successful
0808 16:00:39.446474 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"mutex_wait_us":152,"spinlock_wait_cycles":23680,"thread_start_us":78,"threads_started":1}
I20260808 16:00:39.447247 17345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bec0e15a9204612ad034283f0af881e" candidate_uuid: "ad878c4b8fd1446f8f6db5bfae345b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daa96db3434849218a99abdfccd6ea4b" is_pre_election: true
I20260808 16:00:39.447291 17561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bec0e15a9204612ad034283f0af881e" candidate_uuid: "ad878c4b8fd1446f8f6db5bfae345b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c9db6fb1cf4a1d815ff28462a4d0cf" is_pre_election: true
I20260808 16:00:39.447515 17345 raft_consensus.cc:2454] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad878c4b8fd1446f8f6db5bfae345b5b in term 0.
I20260808 16:00:39.447549 17561 raft_consensus.cc:2454] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad878c4b8fd1446f8f6db5bfae345b5b in term 0.
I20260808 16:00:39.447984 17018 leader_election.cc:302] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad878c4b8fd1446f8f6db5bfae345b5b, f1c9db6fb1cf4a1d815ff28462a4d0cf; no voters:
I20260808 16:00:39.448254 17672 raft_consensus.cc:2781] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 16:00:39.448347 17672 raft_consensus.cc:482] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 16:00:39.448400 17672 raft_consensus.cc:3037] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:39.449364 17672 raft_consensus.cc:504] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad878c4b8fd1446f8f6db5bfae345b5b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38017 } } peers { permanent_uuid: "f1c9db6fb1cf4a1d815ff28462a4d0cf" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 33535 } } peers { permanent_uuid: "daa96db3434849218a99abdfccd6ea4b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40741 } }
I20260808 16:00:39.449676 17672 leader_election.cc:288] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [CANDIDATE]: Term 1 election: Requested vote from peers f1c9db6fb1cf4a1d815ff28462a4d0cf (127.19.93.3:33535), daa96db3434849218a99abdfccd6ea4b (127.19.93.2:40741)
I20260808 16:00:39.449980 17345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bec0e15a9204612ad034283f0af881e" candidate_uuid: "ad878c4b8fd1446f8f6db5bfae345b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daa96db3434849218a99abdfccd6ea4b"
I20260808 16:00:39.449994 17561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bec0e15a9204612ad034283f0af881e" candidate_uuid: "ad878c4b8fd1446f8f6db5bfae345b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c9db6fb1cf4a1d815ff28462a4d0cf"
I20260808 16:00:39.450080 17345 raft_consensus.cc:3037] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:39.450107 17561 raft_consensus.cc:3037] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:39.451018 17345 raft_consensus.cc:2454] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad878c4b8fd1446f8f6db5bfae345b5b in term 1.
I20260808 16:00:39.451289 17019 leader_election.cc:302] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad878c4b8fd1446f8f6db5bfae345b5b, daa96db3434849218a99abdfccd6ea4b; no voters:
I20260808 16:00:39.451306 17561 raft_consensus.cc:2454] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad878c4b8fd1446f8f6db5bfae345b5b in term 1.
I20260808 16:00:39.451459 17672 raft_consensus.cc:2781] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:39.451661 17672 raft_consensus.cc:686] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [term 1 LEADER]: Becoming Leader. State: Replica: ad878c4b8fd1446f8f6db5bfae345b5b, State: Running, Role: LEADER
I20260808 16:00:39.451959 17672 consensus_queue.cc:237] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad878c4b8fd1446f8f6db5bfae345b5b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38017 } } peers { permanent_uuid: "f1c9db6fb1cf4a1d815ff28462a4d0cf" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 33535 } } peers { permanent_uuid: "daa96db3434849218a99abdfccd6ea4b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40741 } }
I20260808 16:00:39.454547 16895 catalog_manager.cc:5495] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to ad878c4b8fd1446f8f6db5bfae345b5b (127.19.93.1). New cstate: current_term: 1 leader_uuid: "ad878c4b8fd1446f8f6db5bfae345b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad878c4b8fd1446f8f6db5bfae345b5b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1c9db6fb1cf4a1d815ff28462a4d0cf" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 33535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "daa96db3434849218a99abdfccd6ea4b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40741 } health_report { overall_health: UNKNOWN } } }
W20260808 16:00:39.459476 17207 tablet.cc:2369] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 16:00:39.476701 17654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.473547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53888 (local address 127.19.93.1:38017)
0808 16:00:39.473666 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:39.473669 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:39.473685 (+ 16us) server_negotiation.cc:407] Connection header received
0808 16:00:39.473785 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:39.473787 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:39.473845 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:39.473939 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 16:00:39.474127 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.474620 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.475397 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.475606 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.475680 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.475967 (+ 287us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 16:00:39.476390 (+ 423us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 16:00:39.476512 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:39.476567 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 16:00:39.476601 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 16:00:39.482287 17561 raft_consensus.cc:1261] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf [term 1 FOLLOWER]: Refusing update from remote peer ad878c4b8fd1446f8f6db5bfae345b5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 16:00:39.482287 17345 raft_consensus.cc:1261] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b [term 1 FOLLOWER]: Refusing update from remote peer ad878c4b8fd1446f8f6db5bfae345b5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 16:00:39.482906 17672 consensus_queue.cc:1035] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "daa96db3434849218a99abdfccd6ea4b" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 40741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 16:00:39.483112 17677 consensus_queue.cc:1035] T 6bec0e15a9204612ad034283f0af881e P ad878c4b8fd1446f8f6db5bfae345b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c9db6fb1cf4a1d815ff28462a4d0cf" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 33535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 16:00:39.500589 16894 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 16:00:39.500749 16894 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 16:00:39.503031 16894 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a191b323825e4d5da1c5bdf37e50d6a6: Sending DeleteTablet for 3 replicas of tablet 6bec0e15a9204612ad034283f0af881e
I20260808 16:00:39.503788 17524 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bec0e15a9204612ad034283f0af881e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:39 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:43660
I20260808 16:00:39.503925 17316 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bec0e15a9204612ad034283f0af881e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:39 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:34390
I20260808 16:00:39.504323 17099 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bec0e15a9204612ad034283f0af881e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:39 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:53886
I20260808 16:00:39.504433 17695 tablet_replica.cc:330] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b: stopping tablet replica
I20260808 16:00:39.504586 17694 tablet_replica.cc:330] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf: stopping tablet replica
I20260808 16:00:39.504748 17695 raft_consensus.cc:2229] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 16:00:39.504866 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 16997
I20260808 16:00:39.505074 17695 raft_consensus.cc:2258] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 16:00:39.505568 17694 raft_consensus.cc:2229] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 16:00:39.505842 17694 raft_consensus.cc:2258] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 16:00:39.508955 17694 ts_tablet_manager.cc:1905] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 16:00:39.512295 17694 ts_tablet_manager.cc:1918] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 16:00:39.512408 17694 log.cc:1196] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/6bec0e15a9204612ad034283f0af881e
I20260808 16:00:39.512691 17694 ts_tablet_manager.cc:1939] T 6bec0e15a9204612ad034283f0af881e P f1c9db6fb1cf4a1d815ff28462a4d0cf: Deleting consensus metadata
I20260808 16:00:39.512666 17695 ts_tablet_manager.cc:1905] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 16:00:39.513716 16865 catalog_manager.cc:4841] TS f1c9db6fb1cf4a1d815ff28462a4d0cf (127.19.93.3:33535): tablet 6bec0e15a9204612ad034283f0af881e (table test-table [id=54a55e23069549f683680e40a0a45abf]) successfully deleted
I20260808 16:00:39.515200 17695 ts_tablet_manager.cc:1918] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 16:00:39.515290 17695 log.cc:1196] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/6bec0e15a9204612ad034283f0af881e
I20260808 16:00:39.515558 17695 ts_tablet_manager.cc:1939] T 6bec0e15a9204612ad034283f0af881e P daa96db3434849218a99abdfccd6ea4b: Deleting consensus metadata
I20260808 16:00:39.516665 16868 catalog_manager.cc:4841] TS daa96db3434849218a99abdfccd6ea4b (127.19.93.2:40741): tablet 6bec0e15a9204612ad034283f0af881e (table test-table [id=54a55e23069549f683680e40a0a45abf]) successfully deleted
W20260808 16:00:39.518693 16870 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:38017 (error 108)
I20260808 16:00:39.519449 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 17212
I20260808 16:00:39.519681 17652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.519387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:38017 (local address 127.0.0.1:53900)
0808 16:00:39.519533 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:39.519602 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:38017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 16:00:39.524734 16870 catalog_manager.cc:4584] TS ad878c4b8fd1446f8f6db5bfae345b5b (127.19.93.1:38017): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6bec0e15a9204612ad034283f0af881e: Network error: Client connection negotiation failed: client connection to 127.19.93.1:38017: connect: Connection refused (error 111)
I20260808 16:00:39.529225 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 17431
I20260808 16:00:39.539511 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 16840
2026-08-08T16:00:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2526 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T16:00:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:00:39Z Disabled control of system clock
I20260808 16:00:39.573781 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:44693
--webserver_interface=127.19.93.62
--webserver_port=0
--builtin_ntp_servers=127.19.93.20:46337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:44693
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 16:00:39.679710 17704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:39.679972 17704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:39.680027 17704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:39.683985 17704 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:39.684036 17704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:39.684049 17704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:39.684064 17704 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:39.684098 17704 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:39.688679 17704 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:46337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:44693
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:44693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:39.689586 17704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:39.690876 17704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:39.698763 17716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:39.698796 17719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:39.698783 17715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:39.698916 17704 server_base.cc:1034] running on GCE node
I20260808 16:00:39.699492 17704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:39.700527 17704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:39.701696 17704 hybrid_clock.cc:648] HybridClock initialized: now 1786204839701680 us; error 27 us; skew 500 ppm
I20260808 16:00:39.703397 17704 webserver.cc:460] Webserver started at http://127.19.93.62:36869/ using document root <none> and password file <none>
I20260808 16:00:39.703914 17704 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:39.703980 17704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:39.704212 17704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:39.706090 17704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "dba34706a61b45a3ade167a46fcc71e8"
format_stamp: "Formatted at 2026-08-08 16:00:39 on dist-test-slave-lgr5"
server_key: "ac4c2afad7648f5eb0552c5ecbfc9c2f"
server_key_iv: "e3f3c1e81d16bf39e24157131b08af4a"
server_key_version: "encryptionkey@0"
I20260808 16:00:39.706621 17704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "dba34706a61b45a3ade167a46fcc71e8"
format_stamp: "Formatted at 2026-08-08 16:00:39 on dist-test-slave-lgr5"
server_key: "ac4c2afad7648f5eb0552c5ecbfc9c2f"
server_key_iv: "e3f3c1e81d16bf39e24157131b08af4a"
server_key_version: "encryptionkey@0"
I20260808 16:00:39.709997 17704 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 16:00:39.712237 17728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:39.713295 17704 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:00:39.713406 17704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "dba34706a61b45a3ade167a46fcc71e8"
format_stamp: "Formatted at 2026-08-08 16:00:39 on dist-test-slave-lgr5"
server_key: "ac4c2afad7648f5eb0552c5ecbfc9c2f"
server_key_iv: "e3f3c1e81d16bf39e24157131b08af4a"
server_key_version: "encryptionkey@0"
I20260808 16:00:39.713495 17704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:39.727245 17704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:39.727800 17704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:39.727954 17704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:39.734371 17704 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:44693
I20260808 16:00:39.734380 17821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:44693 every 8 connection(s)
I20260808 16:00:39.735227 17704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:39.738179 17822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:39.738711 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 17704
I20260808 16:00:39.738828 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:00:39.739095 19828 external_mini_cluster.cc:1428] Setting key 866600d0fd4ea5749a7f0674e1d6b605
I20260808 16:00:39.744809 17822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8: Bootstrap starting.
I20260808 16:00:39.746944 17822 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:39.747665 17822 log.cc:824] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:39.747844 17825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.740301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36986 (local address 127.19.93.62:44693)
0808 16:00:39.740865 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:39.740879 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:39.740913 (+ 34us) server_negotiation.cc:407] Connection header received
0808 16:00:39.741793 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:39.741810 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:39.742178 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:39.742465 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:39.742870 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.743816 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.744734 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.745211 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.745367 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.746209 (+ 842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:39.746213 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:39.746225 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:39.746563 (+ 338us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:39.746618 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:39.746637 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:39.746721 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:39.746865 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 16:00:39.747132 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":259,"thread_start_us":122,"threads_started":1}
I20260808 16:00:39.749655 17822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8: No bootstrap required, opened a new log
I20260808 16:00:39.753034 17822 raft_consensus.cc:348] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba34706a61b45a3ade167a46fcc71e8" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44693 } }
I20260808 16:00:39.753232 17822 raft_consensus.cc:374] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:39.753273 17822 raft_consensus.cc:729] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba34706a61b45a3ade167a46fcc71e8, State: Initialized, Role: FOLLOWER
I20260808 16:00:39.753613 17822 consensus_queue.cc:260] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba34706a61b45a3ade167a46fcc71e8" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44693 } }
I20260808 16:00:39.753724 17822 raft_consensus.cc:388] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:39.753765 17822 raft_consensus.cc:482] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:39.753831 17822 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:39.754598 17822 raft_consensus.cc:504] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba34706a61b45a3ade167a46fcc71e8" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44693 } }
I20260808 16:00:39.754884 17822 leader_election.cc:302] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dba34706a61b45a3ade167a46fcc71e8; no voters:
I20260808 16:00:39.755137 17822 leader_election.cc:288] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:00:39.755240 17827 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:39.755445 17827 raft_consensus.cc:686] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [term 1 LEADER]: Becoming Leader. State: Replica: dba34706a61b45a3ade167a46fcc71e8, State: Running, Role: LEADER
I20260808 16:00:39.755755 17827 consensus_queue.cc:237] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba34706a61b45a3ade167a46fcc71e8" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44693 } }
I20260808 16:00:39.756345 17822 sys_catalog.cc:564] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:39.757417 17830 sys_catalog.cc:455] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dba34706a61b45a3ade167a46fcc71e8. Latest consensus state: current_term: 1 leader_uuid: "dba34706a61b45a3ade167a46fcc71e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba34706a61b45a3ade167a46fcc71e8" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44693 } } }
I20260808 16:00:39.757591 17830 sys_catalog.cc:458] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:39.757411 17828 sys_catalog.cc:455] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dba34706a61b45a3ade167a46fcc71e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba34706a61b45a3ade167a46fcc71e8" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44693 } } }
I20260808 16:00:39.757746 17828 sys_catalog.cc:458] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:39.758059 17843 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:39.761114 17843 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:39.765869 17843 catalog_manager.cc:1347] Generated new cluster ID: ec994d9a2fc54883994851f740b695d2
I20260808 16:00:39.765928 17843 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:39.782522 17843 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:00:39.783336 17843 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:39.788055 17843 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8: Generated new TSK 0
I20260808 16:00:39.788630 17843 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:00:39.797190 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44693
--builtin_ntp_servers=127.19.93.20:46337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 16:00:39.905376 17856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:39.905596 17856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:39.905633 17856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:39.909510 17856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:39.909555 17856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:39.909617 17856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 16:00:39.914155 17856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:46337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44693
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:39.915107 17856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:39.916445 17856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:39.925554 17863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:39.925559 17861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:39.925606 17865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:39.925940 17856 server_base.cc:1034] running on GCE node
I20260808 16:00:39.926333 17856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:39.926887 17856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:39.928045 17856 hybrid_clock.cc:648] HybridClock initialized: now 1786204839928027 us; error 24 us; skew 500 ppm
I20260808 16:00:39.929741 17856 webserver.cc:460] Webserver started at http://127.19.93.1:42357/ using document root <none> and password file <none>
I20260808 16:00:39.930279 17856 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:39.930343 17856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:39.930531 17856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:39.932515 17856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "9ff5486313124d908e58713f7fb5c383"
format_stamp: "Formatted at 2026-08-08 16:00:39 on dist-test-slave-lgr5"
server_key: "1fdec8b6e2275b49d07f2808b2de84bd"
server_key_iv: "2415d333b492b030ed5adf4e81f167fc"
server_key_version: "encryptionkey@0"
I20260808 16:00:39.933069 17856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "9ff5486313124d908e58713f7fb5c383"
format_stamp: "Formatted at 2026-08-08 16:00:39 on dist-test-slave-lgr5"
server_key: "1fdec8b6e2275b49d07f2808b2de84bd"
server_key_iv: "2415d333b492b030ed5adf4e81f167fc"
server_key_version: "encryptionkey@0"
I20260808 16:00:39.936419 17856 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 16:00:39.938648 17878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:39.939741 17856 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:00:39.939844 17856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "9ff5486313124d908e58713f7fb5c383"
format_stamp: "Formatted at 2026-08-08 16:00:39 on dist-test-slave-lgr5"
server_key: "1fdec8b6e2275b49d07f2808b2de84bd"
server_key_iv: "2415d333b492b030ed5adf4e81f167fc"
server_key_version: "encryptionkey@0"
I20260808 16:00:39.939930 17856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:39.952960 17856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:39.953524 17856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:39.953683 17856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:39.954202 17856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:39.955078 17856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:39.955137 17856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:39.955189 17856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:39.955214 17856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:39.963450 17856 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:38419
I20260808 16:00:39.963529 18074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:38419 every 8 connection(s)
I20260808 16:00:39.964318 17856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 16:00:39.972841 17825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.965923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:34435 (local address 127.19.93.62:44693)
0808 16:00:39.966055 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:39.966059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:39.966994 (+ 935us) server_negotiation.cc:407] Connection header received
0808 16:00:39.968338 (+ 1344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:39.968341 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:39.968392 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:39.968454 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:39.969310 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.969853 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.970902 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.971112 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.971205 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.972312 (+ 1107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:39.972316 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:39.972319 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:39.972334 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:39.972359 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:39.972371 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:39.972451 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:39.972611 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 16:00:39.972681 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 16:00:39.973766 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 17856
I20260808 16:00:39.973794 18081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:39.966260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44693 (local address 127.19.93.1:34435)
0808 16:00:39.966874 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:39.966912 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:39.968142 (+ 1230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:39.968591 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:39.968597 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:39.968672 (+ 75us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:39.969165 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:39.969180 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.969949 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.969952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:39.970804 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:39.970814 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:39.971240 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:39.971244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:39.971421 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:39.972016 (+ 595us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 16:00:39.972018 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:39.972056 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 16:00:39.972154 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:39.972468 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:39.972478 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:39.972484 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 16:00:39.972600 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 16:00:39.972871 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":115,"threads_started":1}
I20260808 16:00:39.973887 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 16:00:39.974210 19828 external_mini_cluster.cc:1428] Setting key 35f4e29cc80d7163fa55022298f4ae97
I20260808 16:00:39.974998 18076 heartbeater.cc:347] Connected to a master server at 127.19.93.62:44693
I20260808 16:00:39.975244 18076 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:39.975818 18076 heartbeater.cc:511] Master 127.19.93.62:44693 requested a full tablet report, sending...
I20260808 16:00:39.976382 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44693
--builtin_ntp_servers=127.19.93.20:46337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 16:00:39.978513 17758 ts_manager.cc:194] Registered new tserver with Master: 9ff5486313124d908e58713f7fb5c383 (127.19.93.1:38419)
I20260808 16:00:39.979863 17758 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.93.1:34435
W20260808 16:00:40.086431 18083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:40.086676 18083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:40.086715 18083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:40.090662 18083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:40.090710 18083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:40.090764 18083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 16:00:40.095351 18083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:46337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44693
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:40.096386 18083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:40.097694 18083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:40.106655 18099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:40.106676 18103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:40.106663 18096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:40.106884 18083 server_base.cc:1034] running on GCE node
I20260808 16:00:40.107236 18083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:40.107805 18083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:40.108959 18083 hybrid_clock.cc:648] HybridClock initialized: now 1786204840108931 us; error 42 us; skew 500 ppm
I20260808 16:00:40.110674 18083 webserver.cc:460] Webserver started at http://127.19.93.2:40757/ using document root <none> and password file <none>
I20260808 16:00:40.111188 18083 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:40.111253 18083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:40.111449 18083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:40.113356 18083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "9729160da9b24779b2f272d9172586a8"
format_stamp: "Formatted at 2026-08-08 16:00:40 on dist-test-slave-lgr5"
server_key: "ab92a6842f3ba2f77007de75c93de70c"
server_key_iv: "ca534a6fb5959f02d1e36b50187d3d45"
server_key_version: "encryptionkey@0"
I20260808 16:00:40.113883 18083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "9729160da9b24779b2f272d9172586a8"
format_stamp: "Formatted at 2026-08-08 16:00:40 on dist-test-slave-lgr5"
server_key: "ab92a6842f3ba2f77007de75c93de70c"
server_key_iv: "ca534a6fb5959f02d1e36b50187d3d45"
server_key_version: "encryptionkey@0"
I20260808 16:00:40.117358 18083 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 16:00:40.119689 18111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:40.120880 18083 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:40.120992 18083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "9729160da9b24779b2f272d9172586a8"
format_stamp: "Formatted at 2026-08-08 16:00:40 on dist-test-slave-lgr5"
server_key: "ab92a6842f3ba2f77007de75c93de70c"
server_key_iv: "ca534a6fb5959f02d1e36b50187d3d45"
server_key_version: "encryptionkey@0"
I20260808 16:00:40.121086 18083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:40.148180 18083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:40.148880 18083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:40.149056 18083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:40.149659 18083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:40.150640 18083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:40.150688 18083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:40.150743 18083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:40.150771 18083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:40.159097 18083 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:37225
I20260808 16:00:40.159125 18286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:37225 every 8 connection(s)
I20260808 16:00:40.159948 18083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 16:00:40.163774 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 18083
I20260808 16:00:40.163905 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 16:00:40.164268 19828 external_mini_cluster.cc:1428] Setting key 81b88cae051188dd5a2df45fe317cd26
I20260808 16:00:40.166210 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44693
--builtin_ntp_servers=127.19.93.20:46337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 16:00:40.169333 17825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.161645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:38867 (local address 127.19.93.62:44693)
0808 16:00:40.161777 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:40.161781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:40.162765 (+ 984us) server_negotiation.cc:407] Connection header received
0808 16:00:40.164285 (+ 1520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:40.164288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:40.164344 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:40.164458 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:40.165415 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.165998 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.167471 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.167684 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.167764 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:40.168896 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:40.168900 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:40.168903 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:40.168917 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:40.168940 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:40.168951 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:40.169038 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:40.169151 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 16:00:40.169213 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 16:00:40.170269 18291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.162013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44693 (local address 127.19.93.2:38867)
0808 16:00:40.162624 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:40.162663 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:40.164020 (+ 1357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:40.164647 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:40.164657 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:40.164739 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:40.165279 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:40.165293 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.166128 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.166132 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:40.167348 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:40.167361 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.167822 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.167827 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:40.168027 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:40.168655 (+ 628us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 16:00:40.168657 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:40.168694 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 16:00:40.168753 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:40.169036 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:40.169048 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:40.169051 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 16:00:40.169133 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 16:00:40.169371 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":111,"threads_started":1}
I20260808 16:00:40.171339 18287 heartbeater.cc:347] Connected to a master server at 127.19.93.62:44693
I20260808 16:00:40.171569 18287 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:40.172042 18287 heartbeater.cc:511] Master 127.19.93.62:44693 requested a full tablet report, sending...
I20260808 16:00:40.173039 17758 ts_manager.cc:194] Registered new tserver with Master: 9729160da9b24779b2f272d9172586a8 (127.19.93.2:37225)
I20260808 16:00:40.173583 17758 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.93.2:38867
W20260808 16:00:40.275581 18292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:40.275800 18292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:40.275849 18292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:40.279734 18292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:40.279785 18292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:40.279855 18292 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 16:00:40.284667 18292 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:46337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:44693
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:40.285602 18292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:40.286873 18292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:40.295836 18303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:40.295845 18305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:40.296069 18302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:40.296192 18292 server_base.cc:1034] running on GCE node
I20260808 16:00:40.296627 18292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:40.297226 18292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:40.298400 18292 hybrid_clock.cc:648] HybridClock initialized: now 1786204840298386 us; error 28 us; skew 500 ppm
I20260808 16:00:40.300247 18292 webserver.cc:460] Webserver started at http://127.19.93.3:33325/ using document root <none> and password file <none>
I20260808 16:00:40.300803 18292 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:40.300880 18292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:40.301092 18292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:40.303114 18292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "62bbfc8777d34287b12ac7dd1e8390e4"
format_stamp: "Formatted at 2026-08-08 16:00:40 on dist-test-slave-lgr5"
server_key: "4ee6dbb33f5522f5a9208afbd1de6375"
server_key_iv: "f4a8f0c3caaa841159cf0d0f2b899acb"
server_key_version: "encryptionkey@0"
I20260808 16:00:40.303681 18292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "62bbfc8777d34287b12ac7dd1e8390e4"
format_stamp: "Formatted at 2026-08-08 16:00:40 on dist-test-slave-lgr5"
server_key: "4ee6dbb33f5522f5a9208afbd1de6375"
server_key_iv: "f4a8f0c3caaa841159cf0d0f2b899acb"
server_key_version: "encryptionkey@0"
I20260808 16:00:40.307262 18292 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260808 16:00:40.309705 18313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:40.310815 18292 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 16:00:40.310928 18292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "62bbfc8777d34287b12ac7dd1e8390e4"
format_stamp: "Formatted at 2026-08-08 16:00:40 on dist-test-slave-lgr5"
server_key: "4ee6dbb33f5522f5a9208afbd1de6375"
server_key_iv: "f4a8f0c3caaa841159cf0d0f2b899acb"
server_key_version: "encryptionkey@0"
I20260808 16:00:40.311025 18292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:40.323952 18292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:40.324663 18292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:40.324862 18292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:40.325438 18292 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:40.326383 18292 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:40.326442 18292 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:40.326488 18292 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:40.326522 18292 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:40.335547 18292 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:38753
I20260808 16:00:40.335597 18474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:38753 every 8 connection(s)
I20260808 16:00:40.336481 18292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 16:00:40.343497 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 18292
I20260808 16:00:40.343611 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 16:00:40.343951 19828 external_mini_cluster.cc:1428] Setting key 64ccf199157f08df830aa0d1fbf4495f
I20260808 16:00:40.345449 17825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.338241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:42065 (local address 127.19.93.62:44693)
0808 16:00:40.338378 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:40.338381 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:40.339413 (+ 1032us) server_negotiation.cc:407] Connection header received
0808 16:00:40.340814 (+ 1401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:40.340817 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:40.340870 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:40.340948 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:40.341777 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.342294 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.343486 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.343847 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.343948 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:40.345009 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:40.345014 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:40.345016 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:40.345031 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:40.345054 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:40.345063 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:40.345122 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:40.345279 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 16:00:40.345338 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 16:00:40.346346 18477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.338629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44693 (local address 127.19.93.3:42065)
0808 16:00:40.339285 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:40.339323 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:40.340604 (+ 1281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:40.341096 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:40.341102 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:40.341184 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:40.341645 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:40.341656 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.342443 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.342446 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:40.343364 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:40.343374 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.344006 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.344010 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:40.344202 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:40.344763 (+ 561us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 16:00:40.344765 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:40.344803 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 16:00:40.344863 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:40.345140 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:40.345148 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:40.345154 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 16:00:40.345261 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 16:00:40.345525 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":129,"threads_started":1}
I20260808 16:00:40.347297 18475 heartbeater.cc:347] Connected to a master server at 127.19.93.62:44693
I20260808 16:00:40.347493 18475 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:40.347936 18475 heartbeater.cc:511] Master 127.19.93.62:44693 requested a full tablet report, sending...
I20260808 16:00:40.348868 17758 ts_manager.cc:194] Registered new tserver with Master: 62bbfc8777d34287b12ac7dd1e8390e4 (127.19.93.3:38753)
I20260808 16:00:40.349380 17758 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.93.3:42065
I20260808 16:00:40.357616 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 16:00:40.363150 17825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.359628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36996 (local address 127.19.93.62:44693)
0808 16:00:40.359747 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:40.359750 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:40.359886 (+ 136us) server_negotiation.cc:407] Connection header received
0808 16:00:40.360002 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:40.360004 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:40.360045 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:40.360163 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:40.360400 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.360877 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.361661 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.361879 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.361965 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:40.362810 (+ 845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:40.362815 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:40.362817 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:40.362828 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:40.362844 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:40.362852 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:40.362940 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:40.363019 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 16:00:40.363050 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 16:00:40.365885 17758 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36996:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 16:00:40.368840 17758 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 16:00:40.382650 18492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.376705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:37225 (local address 127.0.0.1:43574)
0808 16:00:40.377030 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:40.377092 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:40.377213 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:40.378281 (+ 1068us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:40.378287 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:40.378311 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:40.378443 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:40.378449 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.379982 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.379985 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:40.381199 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:40.381209 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.382128 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.382132 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:40.382237 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:40.382275 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 16:00:40.382384 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 16:00:40.382521 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":54,"thread_start_us":66,"threads_started":1}
I20260808 16:00:40.382663 18493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.376898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43574 (local address 127.19.93.2:37225)
0808 16:00:40.377769 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:40.377781 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:40.377806 (+ 25us) server_negotiation.cc:407] Connection header received
0808 16:00:40.377886 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:40.377891 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:40.378112 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:40.378590 (+ 478us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:40.378734 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.379872 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.381334 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.382014 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.382111 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:40.382299 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:40.382411 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 16:00:40.382504 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":766,"thread_start_us":177,"threads_started":1}
I20260808 16:00:40.382948 18496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.377379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:38753 (local address 127.0.0.1:46704)
0808 16:00:40.377926 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:40.377938 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:40.378012 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:40.378496 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:40.378499 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:40.378517 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:40.378602 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:40.378607 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.379792 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.379796 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:40.381377 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:40.381395 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.382580 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.382584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:40.382662 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:40.382683 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 16:00:40.382752 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 16:00:40.382823 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"mutex_wait_us":272,"thread_start_us":105,"threads_started":1}
I20260808 16:00:40.383116 18495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.377057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:38419 (local address 127.0.0.1:47462)
0808 16:00:40.377436 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:40.377448 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:40.377526 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:40.378707 (+ 1181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:40.378710 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:40.378728 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:40.378833 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:40.378841 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.380134 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.380137 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:40.381196 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:40.381207 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.382238 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.382242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:40.382329 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:40.382353 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 16:00:40.382400 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 16:00:40.382995 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"mutex_wait_us":529,"thread_start_us":94,"threads_started":1}
I20260808 16:00:40.383368 18498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.377562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46704 (local address 127.19.93.3:38753)
0808 16:00:40.377980 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:40.377994 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:40.378021 (+ 27us) server_negotiation.cc:407] Connection header received
0808 16:00:40.378102 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:40.378108 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:40.378291 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:40.378752 (+ 461us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:40.378883 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.379622 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.381499 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.382252 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.382340 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:40.382505 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:40.383117 (+ 612us) server_negotiation.cc:299] Negotiation successful
0808 16:00:40.383218 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":103,"threads_started":1}
I20260808 16:00:40.383487 18497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.377479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47462 (local address 127.19.93.1:38419)
0808 16:00:40.378263 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:40.378275 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:40.378296 (+ 21us) server_negotiation.cc:407] Connection header received
0808 16:00:40.378365 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:40.378370 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:40.378559 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:40.378703 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:40.378953 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.380016 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.381333 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.382095 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.382509 (+ 414us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:40.382674 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:40.383133 (+ 459us) server_negotiation.cc:299] Negotiation successful
0808 16:00:40.383341 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":678,"thread_start_us":135,"threads_started":1}
I20260808 16:00:40.385710 18382 tablet_service.cc:1467] Processing CreateTablet for tablet 6754b87398cf43b5bf6cde61fb821cae (DEFAULT_TABLE table=test-table [id=95857f269f0c4fc0ba14e7b185908272]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:40.385774 18182 tablet_service.cc:1467] Processing CreateTablet for tablet 6754b87398cf43b5bf6cde61fb821cae (DEFAULT_TABLE table=test-table [id=95857f269f0c4fc0ba14e7b185908272]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:40.385885 17970 tablet_service.cc:1467] Processing CreateTablet for tablet 6754b87398cf43b5bf6cde61fb821cae (DEFAULT_TABLE table=test-table [id=95857f269f0c4fc0ba14e7b185908272]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:40.386632 18382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6754b87398cf43b5bf6cde61fb821cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:40.386781 17970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6754b87398cf43b5bf6cde61fb821cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:40.386781 18182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6754b87398cf43b5bf6cde61fb821cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:40.393496 18502 tablet_bootstrap.cc:492] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383: Bootstrap starting.
I20260808 16:00:40.392351 18500 tablet_bootstrap.cc:492] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4: Bootstrap starting.
I20260808 16:00:40.394300 18501 tablet_bootstrap.cc:492] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8: Bootstrap starting.
I20260808 16:00:40.395718 18502 tablet_bootstrap.cc:654] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:40.395718 18500 tablet_bootstrap.cc:654] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:40.395917 18501 tablet_bootstrap.cc:654] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:40.396587 18501 log.cc:824] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:40.396590 18500 log.cc:824] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:40.396590 18502 log.cc:824] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:40.398186 18502 tablet_bootstrap.cc:492] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383: No bootstrap required, opened a new log
I20260808 16:00:40.398365 18502 ts_tablet_manager.cc:1397] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260808 16:00:40.398379 18500 tablet_bootstrap.cc:492] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4: No bootstrap required, opened a new log
I20260808 16:00:40.398381 18501 tablet_bootstrap.cc:492] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8: No bootstrap required, opened a new log
I20260808 16:00:40.398545 18501 ts_tablet_manager.cc:1397] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260808 16:00:40.398556 18500 ts_tablet_manager.cc:1397] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260808 16:00:40.401492 18502 raft_consensus.cc:348] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9729160da9b24779b2f272d9172586a8" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 37225 } } peers { permanent_uuid: "62bbfc8777d34287b12ac7dd1e8390e4" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38753 } } peers { permanent_uuid: "9ff5486313124d908e58713f7fb5c383" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38419 } }
I20260808 16:00:40.401687 18502 raft_consensus.cc:374] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:40.401738 18502 raft_consensus.cc:729] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ff5486313124d908e58713f7fb5c383, State: Initialized, Role: FOLLOWER
I20260808 16:00:40.402113 18502 consensus_queue.cc:260] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9729160da9b24779b2f272d9172586a8" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 37225 } } peers { permanent_uuid: "62bbfc8777d34287b12ac7dd1e8390e4" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38753 } } peers { permanent_uuid: "9ff5486313124d908e58713f7fb5c383" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38419 } }
I20260808 16:00:40.402683 18076 heartbeater.cc:503] Master 127.19.93.62:44693 was elected leader, sending a full tablet report...
I20260808 16:00:40.402534 18501 raft_consensus.cc:348] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9729160da9b24779b2f272d9172586a8" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 37225 } } peers { permanent_uuid: "62bbfc8777d34287b12ac7dd1e8390e4" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38753 } } peers { permanent_uuid: "9ff5486313124d908e58713f7fb5c383" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38419 } }
I20260808 16:00:40.402534 18500 raft_consensus.cc:348] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9729160da9b24779b2f272d9172586a8" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 37225 } } peers { permanent_uuid: "62bbfc8777d34287b12ac7dd1e8390e4" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38753 } } peers { permanent_uuid: "9ff5486313124d908e58713f7fb5c383" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38419 } }
I20260808 16:00:40.402760 18500 raft_consensus.cc:374] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:40.402760 18501 raft_consensus.cc:374] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:40.402807 18500 raft_consensus.cc:729] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62bbfc8777d34287b12ac7dd1e8390e4, State: Initialized, Role: FOLLOWER
I20260808 16:00:40.402817 18501 raft_consensus.cc:729] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9729160da9b24779b2f272d9172586a8, State: Initialized, Role: FOLLOWER
I20260808 16:00:40.403028 18502 ts_tablet_manager.cc:1428] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260808 16:00:40.403206 18500 consensus_queue.cc:260] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9729160da9b24779b2f272d9172586a8" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 37225 } } peers { permanent_uuid: "62bbfc8777d34287b12ac7dd1e8390e4" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38753 } } peers { permanent_uuid: "9ff5486313124d908e58713f7fb5c383" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38419 } }
I20260808 16:00:40.403258 18501 consensus_queue.cc:260] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9729160da9b24779b2f272d9172586a8" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 37225 } } peers { permanent_uuid: "62bbfc8777d34287b12ac7dd1e8390e4" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38753 } } peers { permanent_uuid: "9ff5486313124d908e58713f7fb5c383" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38419 } }
I20260808 16:00:40.403846 18475 heartbeater.cc:503] Master 127.19.93.62:44693 was elected leader, sending a full tablet report...
I20260808 16:00:40.403847 18287 heartbeater.cc:503] Master 127.19.93.62:44693 was elected leader, sending a full tablet report...
I20260808 16:00:40.404186 18501 ts_tablet_manager.cc:1428] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260808 16:00:40.404873 18500 ts_tablet_manager.cc:1428] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
W20260808 16:00:40.410770 18288 tablet.cc:2369] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 16:00:40.452565 18510 raft_consensus.cc:482] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 16:00:40.452754 18510 raft_consensus.cc:504] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9729160da9b24779b2f272d9172586a8" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 37225 } } peers { permanent_uuid: "62bbfc8777d34287b12ac7dd1e8390e4" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38753 } } peers { permanent_uuid: "9ff5486313124d908e58713f7fb5c383" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38419 } }
I20260808 16:00:40.453845 18510 leader_election.cc:288] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9729160da9b24779b2f272d9172586a8 (127.19.93.2:37225), 62bbfc8777d34287b12ac7dd1e8390e4 (127.19.93.3:38753)
I20260808 16:00:40.457293 18493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.454104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:45961 (local address 127.19.93.2:37225)
0808 16:00:40.454216 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:40.454219 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:40.454233 (+ 14us) server_negotiation.cc:407] Connection header received
0808 16:00:40.454356 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:40.454359 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:40.454412 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:40.454491 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:40.454773 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.455271 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.456301 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.456786 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.456881 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:40.456942 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:40.457110 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 16:00:40.457174 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 16:00:40.457309 18081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.454034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:37225 (local address 127.19.93.1:45961)
0808 16:00:40.454153 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:40.454167 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:40.454251 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:40.454519 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:40.454522 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:40.454554 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:40.454657 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:40.454663 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.455371 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.455374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:40.456185 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:40.456194 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.456894 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.456898 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:40.456997 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:40.457020 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 16:00:40.457086 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 16:00:40.457161 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 16:00:40.457701 18498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.454409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:42041 (local address 127.19.93.3:38753)
0808 16:00:40.454541 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:40.454545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:40.454748 (+ 203us) server_negotiation.cc:407] Connection header received
0808 16:00:40.454860 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:40.454863 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:40.454901 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:40.454959 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:40.455234 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.455705 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.456738 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.457146 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.457239 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:40.457312 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:40.457514 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 16:00:40.457590 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 16:00:40.457974 18212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6754b87398cf43b5bf6cde61fb821cae" candidate_uuid: "9ff5486313124d908e58713f7fb5c383" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9729160da9b24779b2f272d9172586a8" is_pre_election: true
I20260808 16:00:40.458045 18514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.454303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:38753 (local address 127.19.93.1:42041)
0808 16:00:40.454674 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:40.454684 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:40.454771 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:40.454976 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:40.454979 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:40.454995 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:40.455137 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:40.455142 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.455809 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.455812 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:40.456624 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:40.456633 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.457256 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.457260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:40.457362 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:40.457392 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 16:00:40.457837 (+ 445us) client_negotiation.cc:240] Negotiation successful
0808 16:00:40.457902 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":89,"threads_started":1}
I20260808 16:00:40.458256 18212 raft_consensus.cc:2454] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ff5486313124d908e58713f7fb5c383 in term 0.
I20260808 16:00:40.458623 18413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6754b87398cf43b5bf6cde61fb821cae" candidate_uuid: "9ff5486313124d908e58713f7fb5c383" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62bbfc8777d34287b12ac7dd1e8390e4" is_pre_election: true
I20260808 16:00:40.458691 17880 leader_election.cc:302] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9729160da9b24779b2f272d9172586a8, 9ff5486313124d908e58713f7fb5c383; no voters:
I20260808 16:00:40.458878 18413 raft_consensus.cc:2454] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ff5486313124d908e58713f7fb5c383 in term 0.
I20260808 16:00:40.458948 18510 raft_consensus.cc:2781] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 16:00:40.459046 18510 raft_consensus.cc:482] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 16:00:40.459100 18510 raft_consensus.cc:3037] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:40.460105 18510 raft_consensus.cc:504] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9729160da9b24779b2f272d9172586a8" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 37225 } } peers { permanent_uuid: "62bbfc8777d34287b12ac7dd1e8390e4" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38753 } } peers { permanent_uuid: "9ff5486313124d908e58713f7fb5c383" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38419 } }
I20260808 16:00:40.460404 18510 leader_election.cc:288] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [CANDIDATE]: Term 1 election: Requested vote from peers 9729160da9b24779b2f272d9172586a8 (127.19.93.2:37225), 62bbfc8777d34287b12ac7dd1e8390e4 (127.19.93.3:38753)
I20260808 16:00:40.460739 18212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6754b87398cf43b5bf6cde61fb821cae" candidate_uuid: "9ff5486313124d908e58713f7fb5c383" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9729160da9b24779b2f272d9172586a8"
I20260808 16:00:40.460752 18413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6754b87398cf43b5bf6cde61fb821cae" candidate_uuid: "9ff5486313124d908e58713f7fb5c383" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62bbfc8777d34287b12ac7dd1e8390e4"
I20260808 16:00:40.460862 18413 raft_consensus.cc:3037] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:40.460850 18212 raft_consensus.cc:3037] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:40.461786 18212 raft_consensus.cc:2454] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ff5486313124d908e58713f7fb5c383 in term 1.
I20260808 16:00:40.461805 18413 raft_consensus.cc:2454] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ff5486313124d908e58713f7fb5c383 in term 1.
I20260808 16:00:40.462054 17880 leader_election.cc:302] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62bbfc8777d34287b12ac7dd1e8390e4, 9ff5486313124d908e58713f7fb5c383; no voters:
I20260808 16:00:40.462225 18510 raft_consensus.cc:2781] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:40.462441 18510 raft_consensus.cc:686] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [term 1 LEADER]: Becoming Leader. State: Replica: 9ff5486313124d908e58713f7fb5c383, State: Running, Role: LEADER
I20260808 16:00:40.462738 18510 consensus_queue.cc:237] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9729160da9b24779b2f272d9172586a8" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 37225 } } peers { permanent_uuid: "62bbfc8777d34287b12ac7dd1e8390e4" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38753 } } peers { permanent_uuid: "9ff5486313124d908e58713f7fb5c383" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38419 } }
W20260808 16:00:40.465348 18080 tablet.cc:2369] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 16:00:40.465926 17757 catalog_manager.cc:5495] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ff5486313124d908e58713f7fb5c383 (127.19.93.1). New cstate: current_term: 1 leader_uuid: "9ff5486313124d908e58713f7fb5c383" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9729160da9b24779b2f272d9172586a8" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 37225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62bbfc8777d34287b12ac7dd1e8390e4" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ff5486313124d908e58713f7fb5c383" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 38419 } health_report { overall_health: HEALTHY } } }
I20260808 16:00:40.479135 18497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.476202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47464 (local address 127.19.93.1:38419)
0808 16:00:40.476307 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:40.476310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:40.476363 (+ 53us) server_negotiation.cc:407] Connection header received
0808 16:00:40.476464 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:40.476466 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:40.476514 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:40.476593 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 16:00:40.476772 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.477236 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.477976 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:40.478182 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:40.478253 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:40.478478 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 16:00:40.478827 (+ 349us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 16:00:40.478927 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:40.478988 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 16:00:40.479016 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 16:00:40.484522 18212 raft_consensus.cc:1261] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8 [term 1 FOLLOWER]: Refusing update from remote peer 9ff5486313124d908e58713f7fb5c383: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 16:00:40.484522 18413 raft_consensus.cc:1261] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4 [term 1 FOLLOWER]: Refusing update from remote peer 9ff5486313124d908e58713f7fb5c383: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 16:00:40.485138 18510 consensus_queue.cc:1035] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9729160da9b24779b2f272d9172586a8" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 37225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 16:00:40.485319 18516 consensus_queue.cc:1035] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62bbfc8777d34287b12ac7dd1e8390e4" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 38753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 16:00:40.493234 18521 mvcc.cc:205] Tried to move back new op lower bound from 7316295026618355712 to 7316295026537967616. Current Snapshot: MvccSnapshot[applied={T|T < 7316295026618355712}]
I20260808 16:00:40.493417 18520 mvcc.cc:205] Tried to move back new op lower bound from 7316295026618355712 to 7316295026537967616. Current Snapshot: MvccSnapshot[applied={T|T < 7316295026618355712}]
I20260808 16:00:40.502034 17758 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 16:00:40.502216 17758 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 16:00:40.504742 17758 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dba34706a61b45a3ade167a46fcc71e8: Sending DeleteTablet for 3 replicas of tablet 6754b87398cf43b5bf6cde61fb821cae
I20260808 16:00:40.505501 18182 tablet_service.cc:1514] Processing DeleteTablet for tablet 6754b87398cf43b5bf6cde61fb821cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:40 UTC) from {username='slave'} at 127.0.0.1:43574
I20260808 16:00:40.505625 18382 tablet_service.cc:1514] Processing DeleteTablet for tablet 6754b87398cf43b5bf6cde61fb821cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:40 UTC) from {username='slave'} at 127.0.0.1:46704
I20260808 16:00:40.505978 18538 tablet_replica.cc:330] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8: stopping tablet replica
I20260808 16:00:40.505997 17970 tablet_service.cc:1514] Processing DeleteTablet for tablet 6754b87398cf43b5bf6cde61fb821cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:40 UTC) from {username='slave'} at 127.0.0.1:47462
I20260808 16:00:40.506307 18538 raft_consensus.cc:2229] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 16:00:40.506523 18542 tablet_replica.cc:330] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383: stopping tablet replica
I20260808 16:00:40.506644 18538 raft_consensus.cc:2258] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 16:00:40.506901 18542 raft_consensus.cc:2229] T 6754b87398cf43b5bf6cde61fb821cae P 9ff5486313124d908e58713f7fb5c383 [term 1 LEADER]: Raft consensus shutting down.
I20260808 16:00:40.507107 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 17856
I20260808 16:00:40.510643 18538 ts_tablet_manager.cc:1905] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 16:00:40.513095 18538 ts_tablet_manager.cc:1918] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 16:00:40.513181 18538 log.cc:1196] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/6754b87398cf43b5bf6cde61fb821cae
I20260808 16:00:40.513406 18538 ts_tablet_manager.cc:1939] T 6754b87398cf43b5bf6cde61fb821cae P 9729160da9b24779b2f272d9172586a8: Deleting consensus metadata
I20260808 16:00:40.514393 18541 tablet_replica.cc:330] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4: stopping tablet replica
I20260808 16:00:40.514545 17733 catalog_manager.cc:4841] TS 9729160da9b24779b2f272d9172586a8 (127.19.93.2:37225): tablet 6754b87398cf43b5bf6cde61fb821cae (table test-table [id=95857f269f0c4fc0ba14e7b185908272]) successfully deleted
I20260808 16:00:40.514700 18541 raft_consensus.cc:2229] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 16:00:40.514988 18541 raft_consensus.cc:2258] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 16:00:40.516384 18541 ts_tablet_manager.cc:1905] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 16:00:40.518951 18541 ts_tablet_manager.cc:1918] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 16:00:40.519059 18541 log.cc:1196] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/6754b87398cf43b5bf6cde61fb821cae
I20260808 16:00:40.519352 18541 ts_tablet_manager.cc:1939] T 6754b87398cf43b5bf6cde61fb821cae P 62bbfc8777d34287b12ac7dd1e8390e4: Deleting consensus metadata
I20260808 16:00:40.520499 17733 catalog_manager.cc:4841] TS 62bbfc8777d34287b12ac7dd1e8390e4 (127.19.93.3:38753): tablet 6754b87398cf43b5bf6cde61fb821cae (table test-table [id=95857f269f0c4fc0ba14e7b185908272]) successfully deleted
W20260808 16:00:40.521629 17736 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:38419 (error 108)
I20260808 16:00:40.521859 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 18083
I20260808 16:00:40.527318 18495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:40.527027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:38419 (local address 127.0.0.1:47480)
0808 16:00:40.527157 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:40.527230 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:38419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 16:00:40.527503 17736 catalog_manager.cc:4584] TS 9ff5486313124d908e58713f7fb5c383 (127.19.93.1:38419): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6754b87398cf43b5bf6cde61fb821cae: Network error: Client connection negotiation failed: client connection to 127.19.93.1:38419: connect: Connection refused (error 111)
I20260808 16:00:40.533825 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 18292
I20260808 16:00:40.551450 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 17704
2026-08-08T16:00:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1011 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:00:40 dist-test-slave-lgr5 krb5kdc[18548](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:00:40 dist-test-slave-lgr5 krb5kdc[18548](info): set up 2 sockets
Aug 08 16:00:40 dist-test-slave-lgr5 krb5kdc[18548](info): commencing operation
krb5kdc: starting...
W20260808 16:00:41.711735 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:00:41 dist-test-slave-lgr5 krb5kdc[18548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:00:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:00:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 16:00:41.823966 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:37101
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:34653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:37101
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:41.930390 18567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:41.930629 18567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:41.930680 18567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:41.934508 18567 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:41.934557 18567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:41.934582 18567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:41.934602 18567 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:41.934623 18567 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:41.939584 18567 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:34653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:37101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:37101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:41.940524 18567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:41.941439 18567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:41.949304 18581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:41.949326 18577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:41.949311 18576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:41.949754 18567 server_base.cc:1034] running on GCE node
I20260808 16:00:41.950253 18567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:41.951201 18567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:41.952350 18567 hybrid_clock.cc:648] HybridClock initialized: now 1786204841952332 us; error 29 us; skew 500 ppm
Aug 08 16:00:41 dist-test-slave-lgr5 krb5kdc[18548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204841, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:41.954840 18567 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 16:00:41.955691 18567 webserver.cc:460] Webserver started at http://127.19.93.62:43169/ using document root <none> and password file <none>
I20260808 16:00:41.956234 18567 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:41.956305 18567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:41.956494 18567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:41.958391 18567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "497581cedc6c4e4f8e85d6cf4d9371e5"
format_stamp: "Formatted at 2026-08-08 16:00:41 on dist-test-slave-lgr5"
server_key: "4888b72185011edad74b6be5768fa999"
server_key_iv: "571f9a7e2cf5670bcf38a3b429f7c98f"
server_key_version: "encryptionkey@0"
I20260808 16:00:41.958925 18567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "497581cedc6c4e4f8e85d6cf4d9371e5"
format_stamp: "Formatted at 2026-08-08 16:00:41 on dist-test-slave-lgr5"
server_key: "4888b72185011edad74b6be5768fa999"
server_key_iv: "571f9a7e2cf5670bcf38a3b429f7c98f"
server_key_version: "encryptionkey@0"
I20260808 16:00:41.962322 18567 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 16:00:41.964480 18589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:41.965562 18567 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:41.965670 18567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "497581cedc6c4e4f8e85d6cf4d9371e5"
format_stamp: "Formatted at 2026-08-08 16:00:41 on dist-test-slave-lgr5"
server_key: "4888b72185011edad74b6be5768fa999"
server_key_iv: "571f9a7e2cf5670bcf38a3b429f7c98f"
server_key_version: "encryptionkey@0"
I20260808 16:00:41.965758 18567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:41.982265 18567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:41.984767 18567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:41.984941 18567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:41.991513 18567 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:37101
I20260808 16:00:41.991529 18667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:37101 every 8 connection(s)
I20260808 16:00:41.992424 18567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:41.995143 18668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:41.998891 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 18567
I20260808 16:00:41.999010 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:00:41.999253 19828 external_mini_cluster.cc:1428] Setting key 62a29d0baf2b34f0fd6141cf5ca583b3
I20260808 16:00:42.000663 18668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5: Bootstrap starting.
I20260808 16:00:42.003312 18668 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:42.004240 18668 log.cc:824] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:42.006337 18668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5: No bootstrap required, opened a new log
Aug 08 16:00:42 dist-test-slave-lgr5 krb5kdc[18548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:00:42.010546 18668 raft_consensus.cc:348] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497581cedc6c4e4f8e85d6cf4d9371e5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 37101 } }
I20260808 16:00:42.010814 18668 raft_consensus.cc:374] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:42.010874 18668 raft_consensus.cc:729] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 497581cedc6c4e4f8e85d6cf4d9371e5, State: Initialized, Role: FOLLOWER
I20260808 16:00:42.011358 18668 consensus_queue.cc:260] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497581cedc6c4e4f8e85d6cf4d9371e5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 37101 } }
I20260808 16:00:42.011502 18668 raft_consensus.cc:388] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:42.011590 18668 raft_consensus.cc:482] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:42.011700 18668 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:42.012812 18668 raft_consensus.cc:504] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497581cedc6c4e4f8e85d6cf4d9371e5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 37101 } }
I20260808 16:00:42.013185 18668 leader_election.cc:302] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 497581cedc6c4e4f8e85d6cf4d9371e5; no voters:
I20260808 16:00:42.013500 18668 leader_election.cc:288] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:00:42.013592 18675 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:42.013793 18675 raft_consensus.cc:686] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [term 1 LEADER]: Becoming Leader. State: Replica: 497581cedc6c4e4f8e85d6cf4d9371e5, State: Running, Role: LEADER
I20260808 16:00:42.014098 18675 consensus_queue.cc:237] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497581cedc6c4e4f8e85d6cf4d9371e5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 37101 } }
I20260808 16:00:42.014786 18668 sys_catalog.cc:564] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:42.015498 18678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "497581cedc6c4e4f8e85d6cf4d9371e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497581cedc6c4e4f8e85d6cf4d9371e5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 37101 } } }
I20260808 16:00:42.015475 18675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 497581cedc6c4e4f8e85d6cf4d9371e5. Latest consensus state: current_term: 1 leader_uuid: "497581cedc6c4e4f8e85d6cf4d9371e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497581cedc6c4e4f8e85d6cf4d9371e5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 37101 } } }
I20260808 16:00:42.016161 18678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:42.016180 18675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:42.015779 18671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.000547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43680 (local address 127.19.93.62:37101)
0808 16:00:42.000954 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:42.000974 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:42.001016 (+ 42us) server_negotiation.cc:407] Connection header received
0808 16:00:42.001846 (+ 830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:42.001871 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:42.002275 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:42.002630 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:42.003399 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.004814 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.005745 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.006410 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.006584 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.009178 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:42.009184 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:42.009202 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:42.009236 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:42.011177 (+ 1941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:42.011588 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:42.011594 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:42.011600 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:42.011741 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:42.013115 (+ 1374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:42.013119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:42.013120 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:42.013648 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:42.013852 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:42.014169 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 16:00:42.014654 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":104,"threads_started":1}
W20260808 16:00:42.019318 18698 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 16:00:42.019384 18698 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 16:00:42.019476 18690 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:42.020195 18690 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:42.025309 18690 catalog_manager.cc:1347] Generated new cluster ID: 9b689d84baad4effa7a91ce28fbfa092
I20260808 16:00:42.025367 18690 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:42.038583 18690 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:00:42.039734 18690 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:42.047730 18690 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5: Generated new TSK 0
I20260808 16:00:42.048454 18690 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.93.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
Entry for principal kudu/127.19.93.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab.
I20260808 16:00:42.078549 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:37101
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:34653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:42.188499 18709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:42.188725 18709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:42.188789 18709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:42.192704 18709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:42.192755 18709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:42.192831 18709 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 16:00:42.197846 18709 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:34653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.1.keytab
--principal=kudu/127.19.93.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:37101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18709
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:42.198765 18709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:42.199716 18709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:42.208632 18717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:42.208663 18716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:42.208788 18709 server_base.cc:1034] running on GCE node
W20260808 16:00:42.208693 18720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:42.209301 18709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:42.209889 18709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:42.211053 18709 hybrid_clock.cc:648] HybridClock initialized: now 1786204842211039 us; error 30 us; skew 500 ppm
Aug 08 16:00:42 dist-test-slave-lgr5 krb5kdc[18548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204842, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:42.213692 18709 init.cc:377] Logged in from keytab as kudu/127.19.93.1@KRBTEST.COM (short username kudu)
I20260808 16:00:42.214473 18709 webserver.cc:460] Webserver started at http://127.19.93.1:44775/ using document root <none> and password file <none>
I20260808 16:00:42.214977 18709 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:42.215118 18709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:42.215324 18709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:42.217324 18709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "635cd288630249019c2cb6d7c14afc44"
format_stamp: "Formatted at 2026-08-08 16:00:42 on dist-test-slave-lgr5"
server_key: "5d8febaff7151917f78095ebd12cc90b"
server_key_iv: "f1bc82f8f19f5d311ef4ca1e08bd1a4f"
server_key_version: "encryptionkey@0"
I20260808 16:00:42.217846 18709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "635cd288630249019c2cb6d7c14afc44"
format_stamp: "Formatted at 2026-08-08 16:00:42 on dist-test-slave-lgr5"
server_key: "5d8febaff7151917f78095ebd12cc90b"
server_key_iv: "f1bc82f8f19f5d311ef4ca1e08bd1a4f"
server_key_version: "encryptionkey@0"
I20260808 16:00:42.221194 18709 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 16:00:42.223380 18729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:42.224534 18709 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:42.224637 18709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "635cd288630249019c2cb6d7c14afc44"
format_stamp: "Formatted at 2026-08-08 16:00:42 on dist-test-slave-lgr5"
server_key: "5d8febaff7151917f78095ebd12cc90b"
server_key_iv: "f1bc82f8f19f5d311ef4ca1e08bd1a4f"
server_key_version: "encryptionkey@0"
I20260808 16:00:42.224722 18709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:42.234787 18709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:42.237571 18709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:42.237730 18709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:42.238236 18709 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:42.238983 18709 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:42.239034 18709 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:42.239086 18709 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:42.239113 18709 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:42.246917 18709 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:37049
I20260808 16:00:42.246968 18918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:37049 every 8 connection(s)
I20260808 16:00:42.247720 18709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 16:00:42.254213 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 18709
I20260808 16:00:42.254328 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 16:00:42.254588 19828 external_mini_cluster.cc:1428] Setting key 77a5c185dd3f333dddaabfc1fb06e321
Aug 08 16:00:42 dist-test-slave-lgr5 krb5kdc[18548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204842, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.1@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:00:42.260627 18671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.249390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:43009 (local address 127.19.93.62:37101)
0808 16:00:42.249509 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:42.249513 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:42.250445 (+ 932us) server_negotiation.cc:407] Connection header received
0808 16:00:42.251292 (+ 847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:42.251296 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:42.251357 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:42.251437 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:42.252603 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.253295 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.254465 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.254733 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.254833 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.257255 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:42.257259 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:42.257262 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:42.257290 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:42.258659 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:42.259133 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:42.259136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:42.259139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:42.259219 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:42.259526 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:42.259529 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:42.259531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:42.259716 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:42.259803 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:42.260327 (+ 524us) server_negotiation.cc:299] Negotiation successful
0808 16:00:42.260454 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 16:00:42.261358 18921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.249687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:37101 (local address 127.19.93.1:43009)
0808 16:00:42.250298 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:42.250336 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:42.251098 (+ 762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:42.251615 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:42.251622 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:42.251950 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:42.252457 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:42.252472 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.253445 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.253449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:42.254344 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:42.254356 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.254875 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.254880 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:42.255068 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.255659 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:00:42.255675 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:42.257101 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:42.258768 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:42.258774 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:42.258787 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:42.259029 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:42.259301 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:42.259304 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:42.259307 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:42.259438 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:42.259815 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:42.259822 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:42.260059 (+ 237us) client_negotiation.cc:769] Sending connection context
0808 16:00:42.260266 (+ 207us) client_negotiation.cc:240] Negotiation successful
0808 16:00:42.260571 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":103,"threads_started":1}
I20260808 16:00:42.262646 18919 heartbeater.cc:347] Connected to a master server at 127.19.93.62:37101
I20260808 16:00:42.262856 18919 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:42.263304 18919 heartbeater.cc:511] Master 127.19.93.62:37101 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.19.93.2@KRBTEST.COM; defaulting to no policy
I20260808 16:00:42.264863 18617 ts_manager.cc:194] Registered new tserver with Master: 635cd288630249019c2cb6d7c14afc44 (127.19.93.1:37049)
I20260808 16:00:42.265938 18617 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.1@KRBTEST.COM'} at 127.19.93.1:43009
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
Entry for principal kudu/127.19.93.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab.
I20260808 16:00:42.280733 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:37101
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:34653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:42.388156 18926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:42.388391 18926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:42.388432 18926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:42.392289 18926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:42.392340 18926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:42.392408 18926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 16:00:42.397326 18926 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:34653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.2.keytab
--principal=kudu/127.19.93.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:37101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:42.398283 18926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:42.399199 18926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:42.407955 18933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:42.407922 18934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:42.407929 18937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:42.408133 18926 server_base.cc:1034] running on GCE node
I20260808 16:00:42.408619 18926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:42.409191 18926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:42.410352 18926 hybrid_clock.cc:648] HybridClock initialized: now 1786204842410335 us; error 31 us; skew 500 ppm
Aug 08 16:00:42 dist-test-slave-lgr5 krb5kdc[18548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204842, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:42.412914 18926 init.cc:377] Logged in from keytab as kudu/127.19.93.2@KRBTEST.COM (short username kudu)
I20260808 16:00:42.413690 18926 webserver.cc:460] Webserver started at http://127.19.93.2:34211/ using document root <none> and password file <none>
I20260808 16:00:42.414199 18926 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:42.414264 18926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:42.414469 18926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:42.416561 18926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "096b616e730f4eff97f4633f81a18792"
format_stamp: "Formatted at 2026-08-08 16:00:42 on dist-test-slave-lgr5"
server_key: "912bee79ddb96e7dccd38716102aee57"
server_key_iv: "d77471c198656a63e5b07daab69d2d8e"
server_key_version: "encryptionkey@0"
I20260808 16:00:42.417115 18926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "096b616e730f4eff97f4633f81a18792"
format_stamp: "Formatted at 2026-08-08 16:00:42 on dist-test-slave-lgr5"
server_key: "912bee79ddb96e7dccd38716102aee57"
server_key_iv: "d77471c198656a63e5b07daab69d2d8e"
server_key_version: "encryptionkey@0"
I20260808 16:00:42.420604 18926 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 16:00:42.422888 18952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:42.424005 18926 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:42.424166 18926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "096b616e730f4eff97f4633f81a18792"
format_stamp: "Formatted at 2026-08-08 16:00:42 on dist-test-slave-lgr5"
server_key: "912bee79ddb96e7dccd38716102aee57"
server_key_iv: "d77471c198656a63e5b07daab69d2d8e"
server_key_version: "encryptionkey@0"
I20260808 16:00:42.424259 18926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:42.434810 18926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:42.437331 18926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:42.437492 18926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:42.438004 18926 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:42.438741 18926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:42.438787 18926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:42.438835 18926 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:42.438871 18926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:42.447017 18926 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:32803
I20260808 16:00:42.447044 19154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:32803 every 8 connection(s)
I20260808 16:00:42.447804 18926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
Aug 08 16:00:42 dist-test-slave-lgr5 krb5kdc[18548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204842, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.2@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:00:42.456208 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 18926
I20260808 16:00:42.456337 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 16:00:42.456655 19828 external_mini_cluster.cc:1428] Setting key bb01c453f7934457e6f9ad3c3a00c47d
I20260808 16:00:42.459837 18671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.449460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:47241 (local address 127.19.93.62:37101)
0808 16:00:42.449598 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:42.449602 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:42.450499 (+ 897us) server_negotiation.cc:407] Connection header received
0808 16:00:42.451294 (+ 795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:42.451296 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:42.451343 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:42.451410 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:42.452474 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.452992 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.454063 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.454265 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.454330 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.456579 (+ 2249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:42.456584 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:42.456586 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:42.456616 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:42.457946 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:42.458475 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:42.458478 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:42.458479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:42.458556 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:42.458881 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:42.458883 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:42.458884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:42.459053 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:42.459121 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:42.459629 (+ 508us) server_negotiation.cc:299] Negotiation successful
0808 16:00:42.459721 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 16:00:42.460747 19157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.449762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:37101 (local address 127.19.93.2:47241)
0808 16:00:42.450365 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:42.450404 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:42.451127 (+ 723us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:42.451564 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:42.451570 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:42.451886 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:42.452356 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:42.452372 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.453100 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.453103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:42.453971 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:42.453981 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.454368 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.454371 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:42.454498 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.454972 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:00:42.454988 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:42.456384 (+ 1396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:42.458052 (+ 1668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:42.458058 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:42.458071 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:42.458385 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:42.458639 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:42.458642 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:42.458644 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:42.458802 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:42.459138 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:42.459144 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:42.459415 (+ 271us) client_negotiation.cc:769] Sending connection context
0808 16:00:42.459602 (+ 187us) client_negotiation.cc:240] Negotiation successful
0808 16:00:42.459903 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":105,"threads_started":1}
I20260808 16:00:42.461740 19155 heartbeater.cc:347] Connected to a master server at 127.19.93.62:37101
I20260808 16:00:42.461966 19155 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:42.462466 19155 heartbeater.cc:511] Master 127.19.93.62:37101 requested a full tablet report, sending...
I20260808 16:00:42.463518 18617 ts_manager.cc:194] Registered new tserver with Master: 096b616e730f4eff97f4633f81a18792 (127.19.93.2:32803)
I20260808 16:00:42.464072 18617 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.2@KRBTEST.COM'} at 127.19.93.2:47241
WARNING: no policy specified for kudu/127.19.93.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
Entry for principal kudu/127.19.93.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab.
I20260808 16:00:42.483202 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:37101
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:34653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:42.589869 19162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:42.590092 19162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:42.590130 19162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:42.593940 19162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:42.593981 19162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:42.594033 19162 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 16:00:42.598949 19162 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:34653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.3.keytab
--principal=kudu/127.19.93.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:37101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:42.599802 19162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:42.600708 19162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:42.609524 19170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:42.609535 19173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:42.609594 19162 server_base.cc:1034] running on GCE node
W20260808 16:00:42.609524 19171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:42.610157 19162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:42.610684 19162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:42.611853 19162 hybrid_clock.cc:648] HybridClock initialized: now 1786204842611841 us; error 33 us; skew 500 ppm
Aug 08 16:00:42 dist-test-slave-lgr5 krb5kdc[18548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204842, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:42.614369 19162 init.cc:377] Logged in from keytab as kudu/127.19.93.3@KRBTEST.COM (short username kudu)
I20260808 16:00:42.615224 19162 webserver.cc:460] Webserver started at http://127.19.93.3:41221/ using document root <none> and password file <none>
I20260808 16:00:42.615698 19162 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:42.615756 19162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:42.615954 19162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:42.617894 19162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "44d645c7b1c84b70975dc63c31fe05e9"
format_stamp: "Formatted at 2026-08-08 16:00:42 on dist-test-slave-lgr5"
server_key: "8f54454a3624e70043ef93422c813524"
server_key_iv: "9b31aba7efa1f59024b353017a811220"
server_key_version: "encryptionkey@0"
I20260808 16:00:42.618413 19162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "44d645c7b1c84b70975dc63c31fe05e9"
format_stamp: "Formatted at 2026-08-08 16:00:42 on dist-test-slave-lgr5"
server_key: "8f54454a3624e70043ef93422c813524"
server_key_iv: "9b31aba7efa1f59024b353017a811220"
server_key_version: "encryptionkey@0"
I20260808 16:00:42.621744 19162 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 16:00:42.623852 19186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:42.624938 19162 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:00:42.625034 19162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "44d645c7b1c84b70975dc63c31fe05e9"
format_stamp: "Formatted at 2026-08-08 16:00:42 on dist-test-slave-lgr5"
server_key: "8f54454a3624e70043ef93422c813524"
server_key_iv: "9b31aba7efa1f59024b353017a811220"
server_key_version: "encryptionkey@0"
I20260808 16:00:42.625133 19162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:42.654373 19162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:42.657397 19162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:42.657567 19162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:42.658123 19162 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:42.658895 19162 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:42.658941 19162 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:42.658980 19162 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:42.659009 19162 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:42.667197 19162 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:40059
I20260808 16:00:42.667232 19373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:40059 every 8 connection(s)
I20260808 16:00:42.667982 19162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 16:00:42.668825 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 19162
I20260808 16:00:42.668951 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 16:00:42.669265 19828 external_mini_cluster.cc:1428] Setting key a57e6f601c0ecd2a69c5b96806ab1f0e
Aug 08 16:00:42 dist-test-slave-lgr5 krb5kdc[18548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204842, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.3@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:00:42.680117 18671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.669903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:51981 (local address 127.19.93.62:37101)
0808 16:00:42.670135 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:42.670139 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:42.671139 (+ 1000us) server_negotiation.cc:407] Connection header received
0808 16:00:42.672048 (+ 909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:42.672052 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:42.672123 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:42.672193 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:42.673246 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.673758 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.674841 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.675054 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.675152 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.677389 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:42.677392 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:42.677394 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:42.677418 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:42.678503 (+ 1085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:42.678929 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:42.678931 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:42.678932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:42.678995 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:42.679245 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:42.679247 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:42.679248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:42.679397 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:42.679463 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:42.679874 (+ 411us) server_negotiation.cc:299] Negotiation successful
0808 16:00:42.679970 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151}
I20260808 16:00:42.680845 19377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.670332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:37101 (local address 127.19.93.3:51981)
0808 16:00:42.671014 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:42.671052 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:42.671869 (+ 817us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:42.672374 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:42.672380 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:42.672687 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:42.673116 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:42.673129 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.673872 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.673876 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:42.674719 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:42.674729 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.675203 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.675208 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:42.675365 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.675806 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:00:42.675821 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:42.677219 (+ 1398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:42.678610 (+ 1391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:42.678614 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:42.678624 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:42.678857 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:42.679064 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:00:42.679066 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:00:42.679068 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:00:42.679184 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:00:42.679482 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:42.679487 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:42.679700 (+ 213us) client_negotiation.cc:769] Sending connection context
0808 16:00:42.679845 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 16:00:42.680119 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":142,"threads_started":1}
I20260808 16:00:42.681870 19374 heartbeater.cc:347] Connected to a master server at 127.19.93.62:37101
I20260808 16:00:42.682093 19374 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:42.682585 19374 heartbeater.cc:511] Master 127.19.93.62:37101 requested a full tablet report, sending...
I20260808 16:00:42.683548 18617 ts_manager.cc:194] Registered new tserver with Master: 44d645c7b1c84b70975dc63c31fe05e9 (127.19.93.3:40059)
I20260808 16:00:42.684144 18617 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.93.3@KRBTEST.COM'} at 127.19.93.3:51981
I20260808 16:00:42.694332 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 16:00:42.702656 18671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.696170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43682 (local address 127.19.93.62:37101)
0808 16:00:42.696294 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:42.696299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:42.696433 (+ 134us) server_negotiation.cc:407] Connection header received
0808 16:00:42.696523 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:42.696525 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:42.696559 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:42.696617 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:42.697221 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.697995 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.698803 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.699008 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.699081 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.700277 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:42.700279 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:42.700281 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:42.700296 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:42.701342 (+ 1046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:42.701733 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:42.701736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:42.701737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:42.701818 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:42.702010 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:42.702012 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:42.702013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:42.702199 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:42.702296 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:42.702464 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 16:00:42.702549 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 16:00:42.705253 18617 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43682:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 16:00:42.708175 18617 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 16:00:42.721498 19393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.716468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:40059 (local address 127.0.0.1:33438)
0808 16:00:42.716924 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:42.716935 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:42.717000 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:42.717662 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:42.717665 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:42.717681 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:42.717770 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:42.717776 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.718862 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.718865 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:42.719978 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:42.719989 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.720977 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.720980 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:42.721098 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.721139 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 16:00:42.721247 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 16:00:42.721362 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":102,"threads_started":1}
I20260808 16:00:42.721650 19392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.715890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44346 (local address 127.19.93.2:32803)
0808 16:00:42.716354 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:42.716367 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:42.716390 (+ 23us) server_negotiation.cc:407] Connection header received
0808 16:00:42.717106 (+ 716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:42.717112 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:42.717294 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:42.717435 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:42.717735 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.718830 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.720296 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.721058 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.721195 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.721325 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:42.721426 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 16:00:42.721515 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":101,"threads_started":1}
I20260808 16:00:42.721735 19389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.715721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:32803 (local address 127.0.0.1:44346)
0808 16:00:42.716175 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:42.716227 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:42.716357 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:42.717443 (+ 1086us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:42.717449 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:42.717472 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:42.717604 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:42.717612 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.718987 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.718990 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:42.720173 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:42.720184 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.721199 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.721203 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:42.721289 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.721312 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 16:00:42.721397 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 16:00:42.721467 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":74,"threads_started":1}
I20260808 16:00:42.722133 19397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.716874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33438 (local address 127.19.93.3:40059)
0808 16:00:42.717328 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:42.717345 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:42.717362 (+ 17us) server_negotiation.cc:407] Connection header received
0808 16:00:42.717417 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:42.717420 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:42.717541 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:42.717661 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:42.717879 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.718732 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.720104 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.720855 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.720967 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.721124 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:42.721892 (+ 768us) server_negotiation.cc:299] Negotiation successful
0808 16:00:42.721985 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":134,"threads_started":1}
I20260808 16:00:42.722190 19394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.716108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:37049 (local address 127.0.0.1:54386)
0808 16:00:42.716722 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:42.716734 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:42.716811 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:42.718146 (+ 1335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:42.718149 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:42.718169 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:42.718254 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:42.718259 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.719590 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.719594 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:42.720574 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:42.720582 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.721802 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.721810 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:42.721908 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.721932 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 16:00:42.722009 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 16:00:42.722076 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":121,"threads_started":1}
I20260808 16:00:42.722291 19395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.716532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54386 (local address 127.19.93.1:37049)
0808 16:00:42.717729 (+ 1197us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:42.717740 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:42.717759 (+ 19us) server_negotiation.cc:407] Connection header received
0808 16:00:42.717829 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:42.717834 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:42.718001 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:42.718155 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:42.718347 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.719445 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.720681 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.721378 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.721470 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.721905 (+ 435us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:42.722061 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 16:00:42.722154 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1097,"thread_start_us":123,"threads_started":1}
I20260808 16:00:42.724578 19039 tablet_service.cc:1467] Processing CreateTablet for tablet 749c86dbbbaa4a01b52dbb45897d9316 (DEFAULT_TABLE table=test-table [id=98d5eadc58db478e839971ffc50f9dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:42.724730 19255 tablet_service.cc:1467] Processing CreateTablet for tablet 749c86dbbbaa4a01b52dbb45897d9316 (DEFAULT_TABLE table=test-table [id=98d5eadc58db478e839971ffc50f9dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:42.725515 19039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 749c86dbbbaa4a01b52dbb45897d9316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:42.725766 19255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 749c86dbbbaa4a01b52dbb45897d9316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:42.725572 18814 tablet_service.cc:1467] Processing CreateTablet for tablet 749c86dbbbaa4a01b52dbb45897d9316 (DEFAULT_TABLE table=test-table [id=98d5eadc58db478e839971ffc50f9dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:42.726560 18814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 749c86dbbbaa4a01b52dbb45897d9316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:42.732466 19398 tablet_bootstrap.cc:492] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792: Bootstrap starting.
I20260808 16:00:42.733587 19403 tablet_bootstrap.cc:492] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9: Bootstrap starting.
I20260808 16:00:42.734692 19398 tablet_bootstrap.cc:654] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:42.735203 19403 tablet_bootstrap.cc:654] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:42.735392 19398 log.cc:824] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:42.736200 19403 log.cc:824] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:42.736398 19400 tablet_bootstrap.cc:492] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44: Bootstrap starting.
I20260808 16:00:42.737200 19398 tablet_bootstrap.cc:492] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792: No bootstrap required, opened a new log
I20260808 16:00:42.737389 19398 ts_tablet_manager.cc:1397] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260808 16:00:42.738137 19400 tablet_bootstrap.cc:654] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:42.739058 19400 log.cc:824] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:42.740583 19403 tablet_bootstrap.cc:492] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9: No bootstrap required, opened a new log
I20260808 16:00:42.740391 19398 raft_consensus.cc:348] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "096b616e730f4eff97f4633f81a18792" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32803 } } peers { permanent_uuid: "44d645c7b1c84b70975dc63c31fe05e9" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 40059 } } peers { permanent_uuid: "635cd288630249019c2cb6d7c14afc44" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37049 } }
I20260808 16:00:42.740660 19398 raft_consensus.cc:374] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:42.740763 19403 ts_tablet_manager.cc:1397] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.003s
I20260808 16:00:42.740762 19398 raft_consensus.cc:729] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 096b616e730f4eff97f4633f81a18792, State: Initialized, Role: FOLLOWER
I20260808 16:00:42.740891 19400 tablet_bootstrap.cc:492] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44: No bootstrap required, opened a new log
I20260808 16:00:42.741061 19400 ts_tablet_manager.cc:1397] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 16:00:42.741230 19398 consensus_queue.cc:260] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "096b616e730f4eff97f4633f81a18792" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32803 } } peers { permanent_uuid: "44d645c7b1c84b70975dc63c31fe05e9" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 40059 } } peers { permanent_uuid: "635cd288630249019c2cb6d7c14afc44" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37049 } }
I20260808 16:00:42.741874 19155 heartbeater.cc:503] Master 127.19.93.62:37101 was elected leader, sending a full tablet report...
I20260808 16:00:42.742177 19398 ts_tablet_manager.cc:1428] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792: Time spent starting tablet: real 0.005s user 0.002s sys 0.002s
I20260808 16:00:42.744203 19403 raft_consensus.cc:348] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "096b616e730f4eff97f4633f81a18792" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32803 } } peers { permanent_uuid: "44d645c7b1c84b70975dc63c31fe05e9" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 40059 } } peers { permanent_uuid: "635cd288630249019c2cb6d7c14afc44" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37049 } }
I20260808 16:00:42.744467 19403 raft_consensus.cc:374] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:42.744308 19400 raft_consensus.cc:348] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "096b616e730f4eff97f4633f81a18792" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32803 } } peers { permanent_uuid: "44d645c7b1c84b70975dc63c31fe05e9" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 40059 } } peers { permanent_uuid: "635cd288630249019c2cb6d7c14afc44" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37049 } }
I20260808 16:00:42.744561 19403 raft_consensus.cc:729] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44d645c7b1c84b70975dc63c31fe05e9, State: Initialized, Role: FOLLOWER
I20260808 16:00:42.744589 19400 raft_consensus.cc:374] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:42.744674 19400 raft_consensus.cc:729] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 635cd288630249019c2cb6d7c14afc44, State: Initialized, Role: FOLLOWER
I20260808 16:00:42.744963 19403 consensus_queue.cc:260] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "096b616e730f4eff97f4633f81a18792" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32803 } } peers { permanent_uuid: "44d645c7b1c84b70975dc63c31fe05e9" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 40059 } } peers { permanent_uuid: "635cd288630249019c2cb6d7c14afc44" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37049 } }
I20260808 16:00:42.745054 19400 consensus_queue.cc:260] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "096b616e730f4eff97f4633f81a18792" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32803 } } peers { permanent_uuid: "44d645c7b1c84b70975dc63c31fe05e9" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 40059 } } peers { permanent_uuid: "635cd288630249019c2cb6d7c14afc44" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37049 } }
I20260808 16:00:42.745585 19374 heartbeater.cc:503] Master 127.19.93.62:37101 was elected leader, sending a full tablet report...
I20260808 16:00:42.745886 19403 ts_tablet_manager.cc:1428] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 16:00:42.745940 19400 ts_tablet_manager.cc:1428] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 16:00:42.746234 18919 heartbeater.cc:503] Master 127.19.93.62:37101 was elected leader, sending a full tablet report...
W20260808 16:00:42.748721 18920 tablet.cc:2369] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 16:00:42.915032 19415 raft_consensus.cc:482] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 16:00:42.915289 19415 raft_consensus.cc:504] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "096b616e730f4eff97f4633f81a18792" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32803 } } peers { permanent_uuid: "44d645c7b1c84b70975dc63c31fe05e9" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 40059 } } peers { permanent_uuid: "635cd288630249019c2cb6d7c14afc44" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37049 } }
I20260808 16:00:42.916673 19415 leader_election.cc:288] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 096b616e730f4eff97f4633f81a18792 (127.19.93.2:32803), 44d645c7b1c84b70975dc63c31fe05e9 (127.19.93.3:40059)
W20260808 16:00:42.919873 19375 tablet.cc:2369] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 16:00:42.921315 19397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.917467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:55195 (local address 127.19.93.3:40059)
0808 16:00:42.917602 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:42.917606 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:42.917815 (+ 209us) server_negotiation.cc:407] Connection header received
0808 16:00:42.917898 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:42.917900 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:42.917946 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:42.918022 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:42.918228 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.918914 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.920370 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.920787 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.920890 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.920954 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:42.921125 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 16:00:42.921196 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 16:00:42.921339 19417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.917332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:40059 (local address 127.19.93.1:55195)
0808 16:00:42.917714 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:42.917727 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:42.917822 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:42.918038 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:42.918040 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:42.918055 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:42.918138 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:42.918142 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.919005 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.919008 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:42.920213 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:42.920220 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.920905 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.920908 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:42.921008 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.921031 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 16:00:42.921094 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 16:00:42.921167 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":36,"thread_start_us":128,"threads_started":1}
I20260808 16:00:42.921351 19392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.917050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:41885 (local address 127.19.93.2:32803)
0808 16:00:42.917186 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:42.917190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:42.917287 (+ 97us) server_negotiation.cc:407] Connection header received
0808 16:00:42.917513 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:42.917517 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:42.917578 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:42.917671 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:42.917963 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.918736 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.920337 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.920801 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.920901 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.920964 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:42.921164 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 16:00:42.921233 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 16:00:42.921370 19416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.916950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:32803 (local address 127.19.93.1:41885)
0808 16:00:42.917197 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:42.917212 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:42.917332 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:42.917693 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:42.917696 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:42.917715 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:42.917864 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:42.917871 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.918839 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.918851 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:42.920206 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:42.920219 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.920924 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.920928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:42.921054 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.921073 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 16:00:42.921140 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 16:00:42.921214 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":3,"thread_start_us":88,"threads_started":1}
I20260808 16:00:42.921972 19076 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "749c86dbbbaa4a01b52dbb45897d9316" candidate_uuid: "635cd288630249019c2cb6d7c14afc44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096b616e730f4eff97f4633f81a18792" is_pre_election: true
I20260808 16:00:42.922202 19296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "749c86dbbbaa4a01b52dbb45897d9316" candidate_uuid: "635cd288630249019c2cb6d7c14afc44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44d645c7b1c84b70975dc63c31fe05e9" is_pre_election: true
I20260808 16:00:42.922276 19076 raft_consensus.cc:2454] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 635cd288630249019c2cb6d7c14afc44 in term 0.
I20260808 16:00:42.922461 19296 raft_consensus.cc:2454] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 635cd288630249019c2cb6d7c14afc44 in term 0.
I20260808 16:00:42.922760 18731 leader_election.cc:302] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096b616e730f4eff97f4633f81a18792, 635cd288630249019c2cb6d7c14afc44; no voters:
I20260808 16:00:42.923013 19415 raft_consensus.cc:2781] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 16:00:42.923105 19415 raft_consensus.cc:482] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 16:00:42.923157 19415 raft_consensus.cc:3037] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:42.924245 19415 raft_consensus.cc:504] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "096b616e730f4eff97f4633f81a18792" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32803 } } peers { permanent_uuid: "44d645c7b1c84b70975dc63c31fe05e9" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 40059 } } peers { permanent_uuid: "635cd288630249019c2cb6d7c14afc44" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37049 } }
I20260808 16:00:42.924575 19415 leader_election.cc:288] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [CANDIDATE]: Term 1 election: Requested vote from peers 096b616e730f4eff97f4633f81a18792 (127.19.93.2:32803), 44d645c7b1c84b70975dc63c31fe05e9 (127.19.93.3:40059)
I20260808 16:00:42.924901 19076 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "749c86dbbbaa4a01b52dbb45897d9316" candidate_uuid: "635cd288630249019c2cb6d7c14afc44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096b616e730f4eff97f4633f81a18792"
I20260808 16:00:42.924974 19296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "749c86dbbbaa4a01b52dbb45897d9316" candidate_uuid: "635cd288630249019c2cb6d7c14afc44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44d645c7b1c84b70975dc63c31fe05e9"
I20260808 16:00:42.925016 19076 raft_consensus.cc:3037] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:42.925097 19296 raft_consensus.cc:3037] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:42.926005 19076 raft_consensus.cc:2454] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 635cd288630249019c2cb6d7c14afc44 in term 1.
I20260808 16:00:42.926111 19296 raft_consensus.cc:2454] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 635cd288630249019c2cb6d7c14afc44 in term 1.
I20260808 16:00:42.926297 18731 leader_election.cc:302] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096b616e730f4eff97f4633f81a18792, 635cd288630249019c2cb6d7c14afc44; no voters:
I20260808 16:00:42.926465 19415 raft_consensus.cc:2781] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:42.926676 19415 raft_consensus.cc:686] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [term 1 LEADER]: Becoming Leader. State: Replica: 635cd288630249019c2cb6d7c14afc44, State: Running, Role: LEADER
I20260808 16:00:42.926980 19415 consensus_queue.cc:237] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "096b616e730f4eff97f4633f81a18792" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32803 } } peers { permanent_uuid: "44d645c7b1c84b70975dc63c31fe05e9" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 40059 } } peers { permanent_uuid: "635cd288630249019c2cb6d7c14afc44" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37049 } }
I20260808 16:00:42.930279 18617 catalog_manager.cc:5495] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 reported cstate change: term changed from 0 to 1, leader changed from <none> to 635cd288630249019c2cb6d7c14afc44 (127.19.93.1). New cstate: current_term: 1 leader_uuid: "635cd288630249019c2cb6d7c14afc44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "096b616e730f4eff97f4633f81a18792" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44d645c7b1c84b70975dc63c31fe05e9" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 40059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "635cd288630249019c2cb6d7c14afc44" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 37049 } health_report { overall_health: HEALTHY } } }
W20260808 16:00:42.948817 19156 tablet.cc:2369] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 16:00:42.952680 19395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.949351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54392 (local address 127.19.93.1:37049)
0808 16:00:42.949470 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:42.949474 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:42.949487 (+ 13us) server_negotiation.cc:407] Connection header received
0808 16:00:42.949621 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:42.949624 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:42.949676 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:42.949760 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 16:00:42.949990 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.950483 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.951307 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:42.951526 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:42.951609 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:42.951889 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 16:00:42.952317 (+ 428us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 16:00:42.952431 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:42.952503 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 16:00:42.952556 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 16:00:42.958215 19076 raft_consensus.cc:1261] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792 [term 1 FOLLOWER]: Refusing update from remote peer 635cd288630249019c2cb6d7c14afc44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 16:00:42.958216 19296 raft_consensus.cc:1261] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9 [term 1 FOLLOWER]: Refusing update from remote peer 635cd288630249019c2cb6d7c14afc44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 16:00:42.958834 19415 consensus_queue.cc:1035] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44d645c7b1c84b70975dc63c31fe05e9" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 40059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 16:00:42.959021 19418 consensus_queue.cc:1035] T 749c86dbbbaa4a01b52dbb45897d9316 P 635cd288630249019c2cb6d7c14afc44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096b616e730f4eff97f4633f81a18792" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 32803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 16:00:42.967898 19426 mvcc.cc:205] Tried to move back new op lower bound from 7316295036750094336 to 7316295036631519232. Current Snapshot: MvccSnapshot[applied={T|T < 7316295036750094336}]
I20260808 16:00:42.975337 18614 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 16:00:42.975510 18614 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 16:00:42.977937 18614 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 497581cedc6c4e4f8e85d6cf4d9371e5: Sending DeleteTablet for 3 replicas of tablet 749c86dbbbaa4a01b52dbb45897d9316
I20260808 16:00:42.978695 19255 tablet_service.cc:1514] Processing DeleteTablet for tablet 749c86dbbbaa4a01b52dbb45897d9316 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:42 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:33438
I20260808 16:00:42.979131 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 18709
I20260808 16:00:42.979204 18814 tablet_service.cc:1514] Processing DeleteTablet for tablet 749c86dbbbaa4a01b52dbb45897d9316 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:42 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:54386
I20260808 16:00:42.989174 19445 tablet_replica.cc:330] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9: stopping tablet replica
I20260808 16:00:42.989497 19445 raft_consensus.cc:2229] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 16:00:42.989785 19445 raft_consensus.cc:2258] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 16:00:42.990371 19039 tablet_service.cc:1514] Processing DeleteTablet for tablet 749c86dbbbaa4a01b52dbb45897d9316 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:42 UTC) from {username='kudu', principal='kudu/127.19.93.62@KRBTEST.COM'} at 127.0.0.1:44346
I20260808 16:00:42.991233 19445 ts_tablet_manager.cc:1905] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 16:00:42.994024 19445 ts_tablet_manager.cc:1918] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 16:00:42.994128 19445 log.cc:1196] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/749c86dbbbaa4a01b52dbb45897d9316
I20260808 16:00:42.994396 19447 tablet_replica.cc:330] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792: stopping tablet replica
I20260808 16:00:42.994590 19445 ts_tablet_manager.cc:1939] T 749c86dbbbaa4a01b52dbb45897d9316 P 44d645c7b1c84b70975dc63c31fe05e9: Deleting consensus metadata
I20260808 16:00:42.994786 19447 raft_consensus.cc:2229] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 16:00:42.995200 19447 raft_consensus.cc:2258] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 16:00:42.995946 18590 catalog_manager.cc:4841] TS 44d645c7b1c84b70975dc63c31fe05e9 (127.19.93.3:40059): tablet 749c86dbbbaa4a01b52dbb45897d9316 (table test-table [id=98d5eadc58db478e839971ffc50f9dba]) successfully deleted
I20260808 16:00:42.996707 19447 ts_tablet_manager.cc:1905] T 749c86dbbbaa4a01b52dbb45897d9316 P 096b616e730f4eff97f4633f81a18792: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 16:00:42.997133 18593 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:37049 (error 108)
I20260808 16:00:42.998112 19394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:42.997846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:37049 (local address 127.0.0.1:54396)
0808 16:00:42.997970 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:42.998033 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:37049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 16:00:42.998257 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 18926
W20260808 16:00:43.007246 18593 catalog_manager.cc:4584] TS 635cd288630249019c2cb6d7c14afc44 (127.19.93.1:37049): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 749c86dbbbaa4a01b52dbb45897d9316: Network error: Client connection negotiation failed: client connection to 127.19.93.1:37049: connect: Connection refused (error 111)
I20260808 16:00:43.012550 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 19162
I20260808 16:00:43.013000 19394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:43.012677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:32803 (local address 127.0.0.1:44362)
0808 16:00:43.012873 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:43.012918 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.2:32803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122}
I20260808 16:00:43.021885 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 18567
2026-08-08T16:00:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2473 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T16:00:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:00:43Z Disabled control of system clock
I20260808 16:00:43.059017 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:39421
--webserver_interface=127.19.93.62
--webserver_port=0
--builtin_ntp_servers=127.19.93.20:46301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:39421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 16:00:43.167518 19455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:43.167752 19455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:43.167783 19455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:43.171669 19455 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:43.171715 19455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:43.171729 19455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:43.171744 19455 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:43.171761 19455 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:43.176412 19455 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:46301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:39421
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:39421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:43.177327 19455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:43.178596 19455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:43.186367 19466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:43.186384 19462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:43.186419 19463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:43.186434 19455 server_base.cc:1034] running on GCE node
I20260808 16:00:43.187242 19455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:43.188263 19455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:43.189453 19455 hybrid_clock.cc:648] HybridClock initialized: now 1786204843189432 us; error 30 us; skew 500 ppm
I20260808 16:00:43.191128 19455 webserver.cc:460] Webserver started at http://127.19.93.62:45941/ using document root <none> and password file <none>
I20260808 16:00:43.191668 19455 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:43.191730 19455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:43.191926 19455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:43.193922 19455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "eca108f81e704dfd815d49f83dc2e42a"
format_stamp: "Formatted at 2026-08-08 16:00:43 on dist-test-slave-lgr5"
server_key: "fad5bb5aa4b4463cf6d175f7f5e0f1cf"
server_key_iv: "a9abd32ef4f13a4d2bd30087c592f4a9"
server_key_version: "encryptionkey@0"
I20260808 16:00:43.194471 19455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "eca108f81e704dfd815d49f83dc2e42a"
format_stamp: "Formatted at 2026-08-08 16:00:43 on dist-test-slave-lgr5"
server_key: "fad5bb5aa4b4463cf6d175f7f5e0f1cf"
server_key_iv: "a9abd32ef4f13a4d2bd30087c592f4a9"
server_key_version: "encryptionkey@0"
I20260808 16:00:43.197948 19455 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 16:00:43.200285 19476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:43.201452 19455 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:43.201560 19455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "eca108f81e704dfd815d49f83dc2e42a"
format_stamp: "Formatted at 2026-08-08 16:00:43 on dist-test-slave-lgr5"
server_key: "fad5bb5aa4b4463cf6d175f7f5e0f1cf"
server_key_iv: "a9abd32ef4f13a4d2bd30087c592f4a9"
server_key_version: "encryptionkey@0"
I20260808 16:00:43.201654 19455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:43.217659 19455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:43.218252 19455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:43.218417 19455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:43.224720 19455 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:39421
I20260808 16:00:43.224731 19550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:39421 every 8 connection(s)
I20260808 16:00:43.225571 19455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:43.228564 19551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:43.233795 19551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a: Bootstrap starting.
I20260808 16:00:43.234247 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 19455
I20260808 16:00:43.234377 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:00:43.234683 19828 external_mini_cluster.cc:1428] Setting key d0ff91708e9e6c16dcfb5fdddfcadbe5
I20260808 16:00:43.236584 19551 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:43.237263 19551 log.cc:824] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:43.239176 19551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a: No bootstrap required, opened a new log
I20260808 16:00:43.242578 19551 raft_consensus.cc:348] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca108f81e704dfd815d49f83dc2e42a" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39421 } }
I20260808 16:00:43.242786 19551 raft_consensus.cc:374] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:43.242868 19551 raft_consensus.cc:729] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eca108f81e704dfd815d49f83dc2e42a, State: Initialized, Role: FOLLOWER
I20260808 16:00:43.243319 19551 consensus_queue.cc:260] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca108f81e704dfd815d49f83dc2e42a" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39421 } }
I20260808 16:00:43.243456 19551 raft_consensus.cc:388] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:43.243531 19551 raft_consensus.cc:482] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:43.243649 19551 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:43.244073 19557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:43.236036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45992 (local address 127.19.93.62:39421)
0808 16:00:43.236762 (+ 726us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:43.236782 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:43.236823 (+ 41us) server_negotiation.cc:407] Connection header received
0808 16:00:43.237477 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:43.237496 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:43.237958 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:43.238328 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:43.238749 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.239759 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.240718 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.241212 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.241382 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:43.242257 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:43.242262 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:43.242274 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:43.242657 (+ 383us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:43.242714 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:43.242736 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:43.242833 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:43.242988 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 16:00:43.243236 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":115,"threads_started":1}
I20260808 16:00:43.244624 19551 raft_consensus.cc:504] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca108f81e704dfd815d49f83dc2e42a" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39421 } }
I20260808 16:00:43.244964 19551 leader_election.cc:302] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eca108f81e704dfd815d49f83dc2e42a; no voters:
I20260808 16:00:43.245265 19551 leader_election.cc:288] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:00:43.245389 19560 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:43.245584 19560 raft_consensus.cc:686] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [term 1 LEADER]: Becoming Leader. State: Replica: eca108f81e704dfd815d49f83dc2e42a, State: Running, Role: LEADER
I20260808 16:00:43.245915 19560 consensus_queue.cc:237] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca108f81e704dfd815d49f83dc2e42a" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39421 } }
I20260808 16:00:43.246466 19551 sys_catalog.cc:564] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:43.247048 19560 sys_catalog.cc:455] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [sys.catalog]: SysCatalogTable state changed. Reason: New leader eca108f81e704dfd815d49f83dc2e42a. Latest consensus state: current_term: 1 leader_uuid: "eca108f81e704dfd815d49f83dc2e42a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca108f81e704dfd815d49f83dc2e42a" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39421 } } }
I20260808 16:00:43.247254 19560 sys_catalog.cc:458] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:43.247417 19561 sys_catalog.cc:455] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eca108f81e704dfd815d49f83dc2e42a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca108f81e704dfd815d49f83dc2e42a" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39421 } } }
I20260808 16:00:43.247583 19561 sys_catalog.cc:458] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:43.247685 19572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:43.250674 19572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:43.256201 19572 catalog_manager.cc:1347] Generated new cluster ID: a2addec51be348e6ac6c5f93f42477ee
I20260808 16:00:43.256274 19572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:43.268543 19572 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:00:43.269361 19572 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:43.275692 19572 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a: Generated new TSK 0
I20260808 16:00:43.276314 19572 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:00:43.278769 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.1:0
--local_ip_for_outbound_sockets=127.19.93.1
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39421
--builtin_ntp_servers=127.19.93.20:46301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 16:00:43.414103 19592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:43.414335 19592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:43.414371 19592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:43.418342 19592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:43.418401 19592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:43.418452 19592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.1
I20260808 16:00:43.422973 19592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:46301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.93.1
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.1
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:43.423909 19592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:43.425230 19592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:43.434170 19601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:43.434252 19598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:43.434324 19592 server_base.cc:1034] running on GCE node
W20260808 16:00:43.434180 19599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:43.434800 19592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:43.435407 19592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:43.436550 19592 hybrid_clock.cc:648] HybridClock initialized: now 1786204843436525 us; error 42 us; skew 500 ppm
I20260808 16:00:43.442327 19592 webserver.cc:460] Webserver started at http://127.19.93.1:44007/ using document root <none> and password file <none>
I20260808 16:00:43.442863 19592 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:43.442927 19592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:43.443127 19592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:43.445173 19592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/data/instance:
uuid: "e1e66abf959347a99ee155a833520a0b"
format_stamp: "Formatted at 2026-08-08 16:00:43 on dist-test-slave-lgr5"
server_key: "d8c179ddeb8e501536260ad8e4ea0006"
server_key_iv: "321f41b5220d188c7127eac9c2a74984"
server_key_version: "encryptionkey@0"
I20260808 16:00:43.445698 19592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance:
uuid: "e1e66abf959347a99ee155a833520a0b"
format_stamp: "Formatted at 2026-08-08 16:00:43 on dist-test-slave-lgr5"
server_key: "d8c179ddeb8e501536260ad8e4ea0006"
server_key_iv: "321f41b5220d188c7127eac9c2a74984"
server_key_version: "encryptionkey@0"
I20260808 16:00:43.449250 19592 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 16:00:43.451448 19609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:43.452600 19592 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:43.452703 19592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/wal
uuid: "e1e66abf959347a99ee155a833520a0b"
format_stamp: "Formatted at 2026-08-08 16:00:43 on dist-test-slave-lgr5"
server_key: "d8c179ddeb8e501536260ad8e4ea0006"
server_key_iv: "321f41b5220d188c7127eac9c2a74984"
server_key_version: "encryptionkey@0"
I20260808 16:00:43.452796 19592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:43.497051 19592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:43.497757 19592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:43.497936 19592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:43.498536 19592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:43.499483 19592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:43.499532 19592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:43.499588 19592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:43.499615 19592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:43.508262 19592 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.1:36789
I20260808 16:00:43.508293 19777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.1:36789 every 8 connection(s)
I20260808 16:00:43.509126 19592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/data/info.pb
I20260808 16:00:43.516963 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 19592
I20260808 16:00:43.517077 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-0/wal/instance
I20260808 16:00:43.517342 19828 external_mini_cluster.cc:1428] Setting key f2eb53f7c1a47a3f1c0c20f2cec02a2c
I20260808 16:00:43.517814 19557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:43.510841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.1:42745 (local address 127.19.93.62:39421)
0808 16:00:43.511002 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:43.511006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:43.511948 (+ 942us) server_negotiation.cc:407] Connection header received
0808 16:00:43.513274 (+ 1326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:43.513276 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:43.513322 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:43.513399 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:43.514275 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.514796 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.515918 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.516178 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.516270 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:43.517322 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:43.517326 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:43.517329 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:43.517342 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:43.517362 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:43.517370 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:43.517434 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:43.517605 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 16:00:43.517668 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 16:00:43.518692 19782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:43.511211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:39421 (local address 127.19.93.1:42745)
0808 16:00:43.511824 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:43.511862 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:43.513090 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:43.513562 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:43.513568 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:43.513645 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:43.514116 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:43.514129 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.514918 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.514922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:43.515785 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:43.515795 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.516318 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.516323 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:43.516485 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:43.517050 (+ 565us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 16:00:43.517052 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:43.517104 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 16:00:43.517183 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:43.517474 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:43.517483 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:43.517490 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 16:00:43.517591 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 16:00:43.517848 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":127,"threads_started":1}
I20260808 16:00:43.519255 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.2:0
--local_ip_for_outbound_sockets=127.19.93.2
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39421
--builtin_ntp_servers=127.19.93.20:46301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 16:00:43.519748 19779 heartbeater.cc:347] Connected to a master server at 127.19.93.62:39421
I20260808 16:00:43.519954 19779 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:43.520442 19779 heartbeater.cc:511] Master 127.19.93.62:39421 requested a full tablet report, sending...
I20260808 16:00:43.521762 19501 ts_manager.cc:194] Registered new tserver with Master: e1e66abf959347a99ee155a833520a0b (127.19.93.1:36789)
I20260808 16:00:43.522838 19501 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.93.1:42745
W20260808 16:00:43.626210 19785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:43.626449 19785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:43.626502 19785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:43.630333 19785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:43.630381 19785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:43.630452 19785 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.2
I20260808 16:00:43.635010 19785 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:46301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.93.2
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.2
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:43.635902 19785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:43.637135 19785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:43.646015 19799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:43.646023 19796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:43.646010 19795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:43.646281 19785 server_base.cc:1034] running on GCE node
I20260808 16:00:43.646662 19785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:43.647291 19785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:43.648439 19785 hybrid_clock.cc:648] HybridClock initialized: now 1786204843648422 us; error 29 us; skew 500 ppm
I20260808 16:00:43.650117 19785 webserver.cc:460] Webserver started at http://127.19.93.2:38621/ using document root <none> and password file <none>
I20260808 16:00:43.650641 19785 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:43.650698 19785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:43.650857 19785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:43.652803 19785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/data/instance:
uuid: "209c2f887ca44440bfe147fcb0b1975a"
format_stamp: "Formatted at 2026-08-08 16:00:43 on dist-test-slave-lgr5"
server_key: "356693e68413acbc5f2eb735aaf0bed7"
server_key_iv: "0cc29bf0254be0e35ffce7048f958cba"
server_key_version: "encryptionkey@0"
I20260808 16:00:43.653301 19785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance:
uuid: "209c2f887ca44440bfe147fcb0b1975a"
format_stamp: "Formatted at 2026-08-08 16:00:43 on dist-test-slave-lgr5"
server_key: "356693e68413acbc5f2eb735aaf0bed7"
server_key_iv: "0cc29bf0254be0e35ffce7048f958cba"
server_key_version: "encryptionkey@0"
I20260808 16:00:43.656661 19785 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 16:00:43.658828 19809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:43.659912 19785 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:43.660004 19785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/wal
uuid: "209c2f887ca44440bfe147fcb0b1975a"
format_stamp: "Formatted at 2026-08-08 16:00:43 on dist-test-slave-lgr5"
server_key: "356693e68413acbc5f2eb735aaf0bed7"
server_key_iv: "0cc29bf0254be0e35ffce7048f958cba"
server_key_version: "encryptionkey@0"
I20260808 16:00:43.660154 19785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:43.676017 19785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:43.676589 19785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:43.676720 19785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:43.677196 19785 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:43.678022 19785 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:43.678066 19785 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:43.678102 19785 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:43.678122 19785 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:43.686088 19785 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.2:45025
I20260808 16:00:43.686123 19994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.2:45025 every 8 connection(s)
I20260808 16:00:43.686935 19785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/data/info.pb
I20260808 16:00:43.695196 19557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:43.688649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.2:60619 (local address 127.19.93.62:39421)
0808 16:00:43.688773 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:43.688777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:43.689760 (+ 983us) server_negotiation.cc:407] Connection header received
0808 16:00:43.691027 (+ 1267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:43.691029 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:43.691084 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:43.691153 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:43.691950 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.692608 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.693660 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.693860 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.693926 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:43.694813 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:43.694817 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:43.694819 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:43.694831 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:43.694849 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:43.694857 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:43.694910 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:43.695013 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 16:00:43.695083 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 16:00:43.695756 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 19785
I20260808 16:00:43.695871 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/wal/instance
I20260808 16:00:43.695966 19998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:43.688978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:39421 (local address 127.19.93.2:60619)
0808 16:00:43.689611 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:43.689649 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:43.690852 (+ 1203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:43.691294 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:43.691300 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:43.691401 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:43.691842 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:43.691854 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.692728 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.692731 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:43.693571 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:43.693581 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.693959 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.693962 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:43.694095 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:43.694584 (+ 489us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 16:00:43.694585 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:43.694622 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 16:00:43.694681 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:43.694916 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:43.694920 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:43.694924 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 16:00:43.695004 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 16:00:43.695228 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":113,"threads_started":1}
I20260808 16:00:43.696206 19828 external_mini_cluster.cc:1428] Setting key 1f4cb9ccae39869675049d1f80da94fd
I20260808 16:00:43.697077 19995 heartbeater.cc:347] Connected to a master server at 127.19.93.62:39421
I20260808 16:00:43.697281 19995 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:43.697825 19995 heartbeater.cc:511] Master 127.19.93.62:39421 requested a full tablet report, sending...
I20260808 16:00:43.698135 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.93.3:0
--local_ip_for_outbound_sockets=127.19.93.3
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39421
--builtin_ntp_servers=127.19.93.20:46301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 16:00:43.698853 19501 ts_manager.cc:194] Registered new tserver with Master: 209c2f887ca44440bfe147fcb0b1975a (127.19.93.2:45025)
I20260808 16:00:43.699383 19501 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.93.2:60619
W20260808 16:00:43.805559 20002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:43.805776 20002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:43.805825 20002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:43.809702 20002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:43.809746 20002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:43.809816 20002 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.93.3
I20260808 16:00:43.814342 20002 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:46301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.93.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.93.3
--webserver_port=0
--tserver_master_addrs=127.19.93.62:39421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.93.3
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:43.815248 20002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:43.816524 20002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:43.825281 20016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:43.825249 20012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:43.825292 20013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:43.825348 20002 server_base.cc:1034] running on GCE node
I20260808 16:00:43.825829 20002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:43.826375 20002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:43.827538 20002 hybrid_clock.cc:648] HybridClock initialized: now 1786204843827522 us; error 25 us; skew 500 ppm
I20260808 16:00:43.829145 20002 webserver.cc:460] Webserver started at http://127.19.93.3:38367/ using document root <none> and password file <none>
I20260808 16:00:43.829677 20002 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:43.829741 20002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:43.829917 20002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:43.831816 20002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/data/instance:
uuid: "60e46528635a4c1498f2e8d9963c1dcc"
format_stamp: "Formatted at 2026-08-08 16:00:43 on dist-test-slave-lgr5"
server_key: "c5facda40fbb8df6c9453f93cd14f9b5"
server_key_iv: "627b7de56516609e293cfb8f839b0896"
server_key_version: "encryptionkey@0"
I20260808 16:00:43.832350 20002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance:
uuid: "60e46528635a4c1498f2e8d9963c1dcc"
format_stamp: "Formatted at 2026-08-08 16:00:43 on dist-test-slave-lgr5"
server_key: "c5facda40fbb8df6c9453f93cd14f9b5"
server_key_iv: "627b7de56516609e293cfb8f839b0896"
server_key_version: "encryptionkey@0"
I20260808 16:00:43.835614 20002 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 16:00:43.837805 20025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:43.838897 20002 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 16:00:43.839001 20002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/wal
uuid: "60e46528635a4c1498f2e8d9963c1dcc"
format_stamp: "Formatted at 2026-08-08 16:00:43 on dist-test-slave-lgr5"
server_key: "c5facda40fbb8df6c9453f93cd14f9b5"
server_key_iv: "627b7de56516609e293cfb8f839b0896"
server_key_version: "encryptionkey@0"
I20260808 16:00:43.839092 20002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:43.851969 20002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:43.852622 20002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:43.852782 20002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:43.853317 20002 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 16:00:43.854214 20002 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 16:00:43.854260 20002 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:43.854311 20002 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 16:00:43.854341 20002 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:43.862430 20002 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.3:45329
I20260808 16:00:43.862447 20201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.3:45329 every 8 connection(s)
I20260808 16:00:43.863242 20002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/data/info.pb
I20260808 16:00:43.864162 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 20002
I20260808 16:00:43.864255 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/wal/instance
I20260808 16:00:43.864511 19828 external_mini_cluster.cc:1428] Setting key efd0e78e2591a7dce36f15b9e73ed39f
I20260808 16:00:43.872771 19557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:43.865841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:44319 (local address 127.19.93.62:39421)
0808 16:00:43.865957 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:43.865962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:43.867147 (+ 1185us) server_negotiation.cc:407] Connection header received
0808 16:00:43.868506 (+ 1359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:43.868509 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:43.868563 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:43.868632 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:43.869460 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.869983 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.871067 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.871291 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.871376 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:43.872325 (+ 949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:43.872329 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:43.872331 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:43.872344 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:43.872361 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:43.872368 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:43.872431 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:43.872570 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 16:00:43.872630 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 16:00:43.873504 20204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:43.866363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:39421 (local address 127.19.93.3:44319)
0808 16:00:43.867013 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:43.867051 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:43.868294 (+ 1243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:43.868792 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:43.868799 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:43.868875 (+ 76us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:00:43.869318 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:43.869330 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.870096 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.870100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:43.870945 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:43.870955 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.871427 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.871432 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:43.871582 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:43.872063 (+ 481us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 16:00:43.872064 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:00:43.872128 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 16:00:43.872187 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:00:43.872442 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:00:43.872451 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:00:43.872457 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 16:00:43.872557 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 16:00:43.872808 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":121,"threads_started":1}
I20260808 16:00:43.874441 20202 heartbeater.cc:347] Connected to a master server at 127.19.93.62:39421
I20260808 16:00:43.874643 20202 heartbeater.cc:464] Registering TS with master...
I20260808 16:00:43.875113 20202 heartbeater.cc:511] Master 127.19.93.62:39421 requested a full tablet report, sending...
I20260808 16:00:43.876006 19501 ts_manager.cc:194] Registered new tserver with Master: 60e46528635a4c1498f2e8d9963c1dcc (127.19.93.3:45329)
I20260808 16:00:43.876552 19501 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.93.3:44319
I20260808 16:00:43.878186 19828 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 16:00:43.883397 19557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:43.879954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45998 (local address 127.19.93.62:39421)
0808 16:00:43.880069 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:43.880073 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:43.880257 (+ 184us) server_negotiation.cc:407] Connection header received
0808 16:00:43.880365 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:43.880368 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:43.880408 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:43.880472 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:43.880745 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.881228 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.882031 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.882254 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.882336 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:43.883029 (+ 693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:43.883033 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:43.883036 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:43.883057 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:43.883074 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:43.883082 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:43.883138 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:43.883230 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 16:00:43.883278 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 16:00:43.885787 19501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45998:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 16:00:43.888633 19501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 16:00:43.901965 20215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:43.896318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:36789 (local address 127.0.0.1:54860)
0808 16:00:43.896612 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:43.896655 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:43.896765 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:43.897722 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:43.897728 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:43.897750 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:43.897878 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:43.897884 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.899160 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.899163 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:43.900376 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:43.900387 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.901416 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.901419 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:43.901532 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:43.901568 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 16:00:43.901679 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 16:00:43.901824 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":49,"thread_start_us":69,"threads_started":1}
I20260808 16:00:43.901973 20218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:43.896943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54860 (local address 127.19.93.1:36789)
0808 16:00:43.897242 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:43.897252 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:43.897277 (+ 25us) server_negotiation.cc:407] Connection header received
0808 16:00:43.897352 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:43.897357 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:43.897561 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:43.898019 (+ 458us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:43.898170 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.899062 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.900515 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.901283 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.901391 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:43.901588 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:43.901708 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 16:00:43.901810 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":112,"threads_started":1}
I20260808 16:00:43.902153 20216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:43.897132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:45025 (local address 127.0.0.1:35030)
0808 16:00:43.897522 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:43.897534 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:43.897619 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:43.898494 (+ 875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:43.898497 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:43.898515 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:43.898597 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:43.898602 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.899786 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.899790 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:43.900798 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:43.900808 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.901790 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.901794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:43.901884 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:43.901909 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 16:00:43.901956 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 16:00:43.902021 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"mutex_wait_us":3,"thread_start_us":111,"threads_started":1}
I20260808 16:00:43.902187 20217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:43.896818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33490 (local address 127.19.93.3:45329)
0808 16:00:43.897389 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:43.897402 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:43.897470 (+ 68us) server_negotiation.cc:407] Connection header received
0808 16:00:43.897693 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:43.897698 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:43.897861 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:43.897979 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:43.898346 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.899474 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.900796 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.901331 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.901431 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:43.901600 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:43.901940 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 16:00:43.902035 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":134,"threads_started":1}
I20260808 16:00:43.902562 20219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:43.896474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.3:45329 (local address 127.0.0.1:33490)
0808 16:00:43.897377 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:43.897390 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:43.897535 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:43.898134 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:43.898137 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:43.898154 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:43.898234 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:43.898239 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.899593 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.899597 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:43.900691 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:43.900701 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.901668 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.901672 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:43.901776 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:43.901799 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 16:00:43.902365 (+ 566us) client_negotiation.cc:240] Negotiation successful
0808 16:00:43.902441 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":843,"mutex_wait_us":2,"thread_start_us":104,"threads_started":1}
I20260808 16:00:43.902978 20223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:43.897530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35030 (local address 127.19.93.2:45025)
0808 16:00:43.898133 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:43.898143 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:43.898161 (+ 18us) server_negotiation.cc:407] Connection header received
0808 16:00:43.898219 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:43.898222 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:43.898364 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:43.898510 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:43.898685 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.899689 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.900915 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:43.901653 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:43.902513 (+ 860us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:43.902687 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:43.902739 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 16:00:43.902831 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":141,"threads_started":1}
I20260808 16:00:43.904928 19678 tablet_service.cc:1467] Processing CreateTablet for tablet 08bdc2752b7c414a8bbe74502e8de9d9 (DEFAULT_TABLE table=test-table [id=dadaee52830f459bb7670d0945addf81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:43.905874 19678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08bdc2752b7c414a8bbe74502e8de9d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:43.905573 19884 tablet_service.cc:1467] Processing CreateTablet for tablet 08bdc2752b7c414a8bbe74502e8de9d9 (DEFAULT_TABLE table=test-table [id=dadaee52830f459bb7670d0945addf81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:43.905572 20089 tablet_service.cc:1467] Processing CreateTablet for tablet 08bdc2752b7c414a8bbe74502e8de9d9 (DEFAULT_TABLE table=test-table [id=dadaee52830f459bb7670d0945addf81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 16:00:43.906535 19884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08bdc2752b7c414a8bbe74502e8de9d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:43.906535 20089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08bdc2752b7c414a8bbe74502e8de9d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:43.911744 20224 tablet_bootstrap.cc:492] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b: Bootstrap starting.
I20260808 16:00:43.913790 20225 tablet_bootstrap.cc:492] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc: Bootstrap starting.
I20260808 16:00:43.914563 20224 tablet_bootstrap.cc:654] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:43.915262 20224 log.cc:824] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:43.915484 20225 tablet_bootstrap.cc:654] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:43.915889 20226 tablet_bootstrap.cc:492] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a: Bootstrap starting.
I20260808 16:00:43.916304 20225 log.cc:824] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:43.917290 20224 tablet_bootstrap.cc:492] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b: No bootstrap required, opened a new log
I20260808 16:00:43.917485 20224 ts_tablet_manager.cc:1397] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260808 16:00:43.917724 20226 tablet_bootstrap.cc:654] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:43.918211 20225 tablet_bootstrap.cc:492] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc: No bootstrap required, opened a new log
I20260808 16:00:43.918391 20225 ts_tablet_manager.cc:1397] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260808 16:00:43.918493 20226 log.cc:824] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:43.920017 20226 tablet_bootstrap.cc:492] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a: No bootstrap required, opened a new log
I20260808 16:00:43.920202 20226 ts_tablet_manager.cc:1397] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260808 16:00:43.921739 20224 raft_consensus.cc:348] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e66abf959347a99ee155a833520a0b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36789 } } peers { permanent_uuid: "60e46528635a4c1498f2e8d9963c1dcc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45329 } } peers { permanent_uuid: "209c2f887ca44440bfe147fcb0b1975a" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45025 } }
I20260808 16:00:43.922031 20224 raft_consensus.cc:374] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:43.922091 20224 raft_consensus.cc:729] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e66abf959347a99ee155a833520a0b, State: Initialized, Role: FOLLOWER
I20260808 16:00:43.922343 20225 raft_consensus.cc:348] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e66abf959347a99ee155a833520a0b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36789 } } peers { permanent_uuid: "60e46528635a4c1498f2e8d9963c1dcc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45329 } } peers { permanent_uuid: "209c2f887ca44440bfe147fcb0b1975a" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45025 } }
I20260808 16:00:43.922590 20225 raft_consensus.cc:374] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:43.922638 20225 raft_consensus.cc:729] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60e46528635a4c1498f2e8d9963c1dcc, State: Initialized, Role: FOLLOWER
I20260808 16:00:43.922565 20224 consensus_queue.cc:260] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e66abf959347a99ee155a833520a0b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36789 } } peers { permanent_uuid: "60e46528635a4c1498f2e8d9963c1dcc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45329 } } peers { permanent_uuid: "209c2f887ca44440bfe147fcb0b1975a" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45025 } }
I20260808 16:00:43.923053 20225 consensus_queue.cc:260] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e66abf959347a99ee155a833520a0b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36789 } } peers { permanent_uuid: "60e46528635a4c1498f2e8d9963c1dcc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45329 } } peers { permanent_uuid: "209c2f887ca44440bfe147fcb0b1975a" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45025 } }
I20260808 16:00:43.923339 20226 raft_consensus.cc:348] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e66abf959347a99ee155a833520a0b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36789 } } peers { permanent_uuid: "60e46528635a4c1498f2e8d9963c1dcc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45329 } } peers { permanent_uuid: "209c2f887ca44440bfe147fcb0b1975a" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45025 } }
I20260808 16:00:43.923565 20224 ts_tablet_manager.cc:1428] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260808 16:00:43.923596 20226 raft_consensus.cc:374] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:43.923652 20226 raft_consensus.cc:729] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 209c2f887ca44440bfe147fcb0b1975a, State: Initialized, Role: FOLLOWER
I20260808 16:00:43.923810 20202 heartbeater.cc:503] Master 127.19.93.62:39421 was elected leader, sending a full tablet report...
I20260808 16:00:43.923898 19779 heartbeater.cc:503] Master 127.19.93.62:39421 was elected leader, sending a full tablet report...
I20260808 16:00:43.923951 20225 ts_tablet_manager.cc:1428] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260808 16:00:43.924072 20226 consensus_queue.cc:260] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e66abf959347a99ee155a833520a0b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36789 } } peers { permanent_uuid: "60e46528635a4c1498f2e8d9963c1dcc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45329 } } peers { permanent_uuid: "209c2f887ca44440bfe147fcb0b1975a" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45025 } }
I20260808 16:00:43.924705 19995 heartbeater.cc:503] Master 127.19.93.62:39421 was elected leader, sending a full tablet report...
I20260808 16:00:43.926056 20226 ts_tablet_manager.cc:1428] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
W20260808 16:00:43.937795 19996 tablet.cc:2369] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 16:00:44.010206 19780 tablet.cc:2369] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 16:00:44.114254 20203 tablet.cc:2369] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 16:00:44.131852 20234 raft_consensus.cc:482] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 16:00:44.132064 20234 raft_consensus.cc:504] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e66abf959347a99ee155a833520a0b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36789 } } peers { permanent_uuid: "60e46528635a4c1498f2e8d9963c1dcc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45329 } } peers { permanent_uuid: "209c2f887ca44440bfe147fcb0b1975a" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45025 } }
I20260808 16:00:44.133205 20234 leader_election.cc:288] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e66abf959347a99ee155a833520a0b (127.19.93.1:36789), 209c2f887ca44440bfe147fcb0b1975a (127.19.93.2:45025)
I20260808 16:00:44.136682 20204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:44.133436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:36789 (local address 127.19.93.3:53987)
0808 16:00:44.133559 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:44.133575 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:44.133670 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:44.133936 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:44.133939 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:44.133960 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:44.134063 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:44.134069 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:44.134817 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:44.134821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:44.135610 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:44.135619 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:44.136282 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:44.136285 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:44.136381 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:44.136400 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 16:00:44.136472 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 16:00:44.136544 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 16:00:44.136682 20218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:44.133568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:53987 (local address 127.19.93.1:36789)
0808 16:00:44.133698 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:44.133702 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:44.133717 (+ 15us) server_negotiation.cc:407] Connection header received
0808 16:00:44.133775 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:44.133777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:44.133819 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:44.133894 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:44.134181 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:44.134715 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:44.135738 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:44.136171 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:44.136268 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:44.136332 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:44.136491 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 16:00:44.136561 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 16:00:44.137027 20223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:44.133570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.93.3:37167 (local address 127.19.93.2:45025)
0808 16:00:44.133697 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:44.133702 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:44.134019 (+ 317us) server_negotiation.cc:407] Connection header received
0808 16:00:44.134137 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:44.134140 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:44.134184 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:44.134245 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 16:00:44.134507 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:44.135025 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:44.136024 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:44.136444 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:44.136551 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:44.136609 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:44.136830 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 16:00:44.136907 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 16:00:44.137357 20238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:44.133436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.2:45025 (local address 127.19.93.3:37167)
0808 16:00:44.133926 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:44.133937 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 16:00:44.134028 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:00:44.134268 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:00:44.134271 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:00:44.134287 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 16:00:44.134404 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:44.134409 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:44.135145 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:44.135148 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:44.135908 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:00:44.135916 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:00:44.136579 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:00:44.136583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:00:44.136690 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:44.136707 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 16:00:44.137186 (+ 479us) client_negotiation.cc:240] Negotiation successful
0808 16:00:44.137251 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"mutex_wait_us":154,"thread_start_us":120,"threads_started":1}
I20260808 16:00:44.137686 19708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08bdc2752b7c414a8bbe74502e8de9d9" candidate_uuid: "60e46528635a4c1498f2e8d9963c1dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e66abf959347a99ee155a833520a0b" is_pre_election: true
I20260808 16:00:44.137989 19708 raft_consensus.cc:2454] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60e46528635a4c1498f2e8d9963c1dcc in term 0.
I20260808 16:00:44.137975 19919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08bdc2752b7c414a8bbe74502e8de9d9" candidate_uuid: "60e46528635a4c1498f2e8d9963c1dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "209c2f887ca44440bfe147fcb0b1975a" is_pre_election: true
I20260808 16:00:44.138221 19919 raft_consensus.cc:2454] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60e46528635a4c1498f2e8d9963c1dcc in term 0.
I20260808 16:00:44.138464 20026 leader_election.cc:302] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60e46528635a4c1498f2e8d9963c1dcc, e1e66abf959347a99ee155a833520a0b; no voters:
I20260808 16:00:44.138773 20234 raft_consensus.cc:2781] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 16:00:44.138854 20234 raft_consensus.cc:482] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 16:00:44.138916 20234 raft_consensus.cc:3037] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:44.139916 20234 raft_consensus.cc:504] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e66abf959347a99ee155a833520a0b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36789 } } peers { permanent_uuid: "60e46528635a4c1498f2e8d9963c1dcc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45329 } } peers { permanent_uuid: "209c2f887ca44440bfe147fcb0b1975a" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45025 } }
I20260808 16:00:44.140269 20234 leader_election.cc:288] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [CANDIDATE]: Term 1 election: Requested vote from peers e1e66abf959347a99ee155a833520a0b (127.19.93.1:36789), 209c2f887ca44440bfe147fcb0b1975a (127.19.93.2:45025)
I20260808 16:00:44.140601 19708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08bdc2752b7c414a8bbe74502e8de9d9" candidate_uuid: "60e46528635a4c1498f2e8d9963c1dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e66abf959347a99ee155a833520a0b"
I20260808 16:00:44.140612 19919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08bdc2752b7c414a8bbe74502e8de9d9" candidate_uuid: "60e46528635a4c1498f2e8d9963c1dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "209c2f887ca44440bfe147fcb0b1975a"
I20260808 16:00:44.140707 19919 raft_consensus.cc:3037] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:44.140718 19708 raft_consensus.cc:3037] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:44.141671 19919 raft_consensus.cc:2454] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e46528635a4c1498f2e8d9963c1dcc in term 1.
I20260808 16:00:44.141775 19708 raft_consensus.cc:2454] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e46528635a4c1498f2e8d9963c1dcc in term 1.
I20260808 16:00:44.141975 20028 leader_election.cc:302] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 209c2f887ca44440bfe147fcb0b1975a, 60e46528635a4c1498f2e8d9963c1dcc; no voters:
I20260808 16:00:44.142179 20234 raft_consensus.cc:2781] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:44.142386 20234 raft_consensus.cc:686] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [term 1 LEADER]: Becoming Leader. State: Replica: 60e46528635a4c1498f2e8d9963c1dcc, State: Running, Role: LEADER
I20260808 16:00:44.142731 20234 consensus_queue.cc:237] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e66abf959347a99ee155a833520a0b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36789 } } peers { permanent_uuid: "60e46528635a4c1498f2e8d9963c1dcc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45329 } } peers { permanent_uuid: "209c2f887ca44440bfe147fcb0b1975a" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45025 } }
I20260808 16:00:44.145821 19499 catalog_manager.cc:5495] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc reported cstate change: term changed from 0 to 1, leader changed from <none> to 60e46528635a4c1498f2e8d9963c1dcc (127.19.93.3). New cstate: current_term: 1 leader_uuid: "60e46528635a4c1498f2e8d9963c1dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e66abf959347a99ee155a833520a0b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e46528635a4c1498f2e8d9963c1dcc" member_type: VOTER last_known_addr { host: "127.19.93.3" port: 45329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "209c2f887ca44440bfe147fcb0b1975a" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45025 } health_report { overall_health: UNKNOWN } } }
I20260808 16:00:44.192422 20217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:44.189020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33494 (local address 127.19.93.3:45329)
0808 16:00:44.189154 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:44.189158 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:44.189174 (+ 16us) server_negotiation.cc:407] Connection header received
0808 16:00:44.189288 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:44.189290 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:44.189344 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:44.189442 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 16:00:44.189681 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:44.190179 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:44.191014 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:44.191226 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:44.191314 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:44.191613 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 16:00:44.192019 (+ 406us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 16:00:44.192169 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:44.192203 (+ 34us) server_negotiation.cc:299] Negotiation successful
0808 16:00:44.192253 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 16:00:44.198072 19919 raft_consensus.cc:1261] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a [term 1 FOLLOWER]: Refusing update from remote peer 60e46528635a4c1498f2e8d9963c1dcc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 16:00:44.198081 19708 raft_consensus.cc:1261] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b [term 1 FOLLOWER]: Refusing update from remote peer 60e46528635a4c1498f2e8d9963c1dcc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 16:00:44.198729 20234 consensus_queue.cc:1035] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e66abf959347a99ee155a833520a0b" member_type: VOTER last_known_addr { host: "127.19.93.1" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 16:00:44.198907 20240 consensus_queue.cc:1035] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "209c2f887ca44440bfe147fcb0b1975a" member_type: VOTER last_known_addr { host: "127.19.93.2" port: 45025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 16:00:44.212709 19499 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45998:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 16:00:44.212878 19499 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45998:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 16:00:44.215335 19499 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eca108f81e704dfd815d49f83dc2e42a: Sending DeleteTablet for 3 replicas of tablet 08bdc2752b7c414a8bbe74502e8de9d9
I20260808 16:00:44.216068 20089 tablet_service.cc:1514] Processing DeleteTablet for tablet 08bdc2752b7c414a8bbe74502e8de9d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:44 UTC) from {username='slave'} at 127.0.0.1:33490
I20260808 16:00:44.216187 19678 tablet_service.cc:1514] Processing DeleteTablet for tablet 08bdc2752b7c414a8bbe74502e8de9d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:44 UTC) from {username='slave'} at 127.0.0.1:54860
I20260808 16:00:44.216668 20257 tablet_replica.cc:330] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc: stopping tablet replica
I20260808 16:00:44.217011 19884 tablet_service.cc:1514] Processing DeleteTablet for tablet 08bdc2752b7c414a8bbe74502e8de9d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 16:00:44 UTC) from {username='slave'} at 127.0.0.1:35030
I20260808 16:00:44.217268 20257 raft_consensus.cc:2229] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [term 1 LEADER]: Raft consensus shutting down.
I20260808 16:00:44.217703 20261 tablet_replica.cc:330] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a: stopping tablet replica
I20260808 16:00:44.217922 20257 raft_consensus.cc:2258] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 16:00:44.217988 20261 raft_consensus.cc:2229] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 16:00:44.218307 20261 raft_consensus.cc:2258] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 16:00:44.218639 20258 tablet_replica.cc:330] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b: stopping tablet replica
I20260808 16:00:44.219146 20258 raft_consensus.cc:2229] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 16:00:44.219754 20257 ts_tablet_manager.cc:1905] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 16:00:44.219754 20261 ts_tablet_manager.cc:1905] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 16:00:44.219795 20258 raft_consensus.cc:2258] T 08bdc2752b7c414a8bbe74502e8de9d9 P e1e66abf959347a99ee155a833520a0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 16:00:44.220779 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 19592
I20260808 16:00:44.232478 20261 ts_tablet_manager.cc:1918] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 16:00:44.232580 20261 log.cc:1196] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-1/wal/wals/08bdc2752b7c414a8bbe74502e8de9d9
I20260808 16:00:44.232947 20261 ts_tablet_manager.cc:1939] T 08bdc2752b7c414a8bbe74502e8de9d9 P 209c2f887ca44440bfe147fcb0b1975a: Deleting consensus metadata
I20260808 16:00:44.236543 19481 catalog_manager.cc:4841] TS 209c2f887ca44440bfe147fcb0b1975a (127.19.93.2:45025): tablet 08bdc2752b7c414a8bbe74502e8de9d9 (table test-table [id=dadaee52830f459bb7670d0945addf81]) successfully deleted
W20260808 16:00:44.242786 19479 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.93.1:36789 (error 108)
I20260808 16:00:44.243579 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 19785
I20260808 16:00:44.245728 20257 ts_tablet_manager.cc:1918] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 16:00:44.245957 20257 log.cc:1196] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc: Deleting WAL directory at /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786204595622323-19828-0/minicluster-data/ts-2/wal/wals/08bdc2752b7c414a8bbe74502e8de9d9
I20260808 16:00:44.246409 20257 ts_tablet_manager.cc:1939] T 08bdc2752b7c414a8bbe74502e8de9d9 P 60e46528635a4c1498f2e8d9963c1dcc: Deleting consensus metadata
I20260808 16:00:44.247617 19482 catalog_manager.cc:4841] TS 60e46528635a4c1498f2e8d9963c1dcc (127.19.93.3:45329): tablet 08bdc2752b7c414a8bbe74502e8de9d9 (table test-table [id=dadaee52830f459bb7670d0945addf81]) successfully deleted
I20260808 16:00:44.254179 20219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:44.253894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.1:36789 (local address 127.0.0.1:54866)
0808 16:00:44.254050 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 16:00:44.254107 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.1:36789: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260808 16:00:44.254316 19479 catalog_manager.cc:4584] TS e1e66abf959347a99ee155a833520a0b (127.19.93.1:36789): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 08bdc2752b7c414a8bbe74502e8de9d9: Network error: Client connection negotiation failed: client connection to 127.19.93.1:36789: connect: Connection refused (error 111)
I20260808 16:00:44.268839 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 20002
I20260808 16:00:44.276188 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 19455
2026-08-08T16:00:44Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1253 ms)
[----------] 6 tests from EncryptionPolicyTest (10899 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:00:44 dist-test-slave-lgr5 krb5kdc[20268](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:00:44 dist-test-slave-lgr5 krb5kdc[20268](info): set up 2 sockets
Aug 08 16:00:44 dist-test-slave-lgr5 krb5kdc[20268](info): commencing operation
krb5kdc: starting...
W20260808 16:00:45.434062 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:00:45 dist-test-slave-lgr5 krb5kdc[20268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:00:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:00:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 16:00:45.550835 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44345
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44345
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:45.659145 20286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:45.659382 20286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:45.659425 20286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:45.663292 20286 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:45.663348 20286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:45.663369 20286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:45.663398 20286 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:45.663425 20286 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:45.668401 20286 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44345
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:45.669273 20286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:45.670192 20286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:45.678092 20298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:45.678167 20286 server_base.cc:1034] running on GCE node
W20260808 16:00:45.678119 20295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:45.678099 20296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:45.678843 20286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:45.679800 20286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:45.680949 20286 hybrid_clock.cc:648] HybridClock initialized: now 1786204845680927 us; error 31 us; skew 500 ppm
Aug 08 16:00:45 dist-test-slave-lgr5 krb5kdc[20268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204845, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:45.683459 20286 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 16:00:45.684271 20286 webserver.cc:460] Webserver started at http://127.0.0.1:45037/ using document root <none> and password file <none>
I20260808 16:00:45.684762 20286 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:45.684818 20286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:45.684973 20286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:45.686825 20286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "b433e541550a4c4a90bad6341d665114"
format_stamp: "Formatted at 2026-08-08 16:00:45 on dist-test-slave-lgr5"
server_key: "a505003103b7877778bf035d5afe277e"
server_key_iv: "ce9a198909d9e1cabdeee8a2d842a4a6"
server_key_version: "encryptionkey@0"
I20260808 16:00:45.687307 20286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "b433e541550a4c4a90bad6341d665114"
format_stamp: "Formatted at 2026-08-08 16:00:45 on dist-test-slave-lgr5"
server_key: "a505003103b7877778bf035d5afe277e"
server_key_iv: "ce9a198909d9e1cabdeee8a2d842a4a6"
server_key_version: "encryptionkey@0"
I20260808 16:00:45.690768 20286 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 16:00:45.693085 20308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:45.694181 20286 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:45.694285 20286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "b433e541550a4c4a90bad6341d665114"
format_stamp: "Formatted at 2026-08-08 16:00:45 on dist-test-slave-lgr5"
server_key: "a505003103b7877778bf035d5afe277e"
server_key_iv: "ce9a198909d9e1cabdeee8a2d842a4a6"
server_key_version: "encryptionkey@0"
I20260808 16:00:45.694378 20286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:45.722610 20286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:45.725517 20286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:45.725693 20286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:45.732261 20286 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44345
I20260808 16:00:45.732292 20390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44345 every 8 connection(s)
I20260808 16:00:45.733129 20286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:45.735636 20391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:45.736224 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 20286
I20260808 16:00:45.736357 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:00:45.736673 19828 external_mini_cluster.cc:1428] Setting key 8f2f2a1b299dad5d5295297770d40d54
I20260808 16:00:45.741405 20391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114: Bootstrap starting.
I20260808 16:00:45.743423 20391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:45.744122 20391 log.cc:824] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114: Log is configured to *not* fsync() on all Append() calls
Aug 08 16:00:45 dist-test-slave-lgr5 krb5kdc[20268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 16:00:45.745863 20391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114: No bootstrap required, opened a new log
I20260808 16:00:45.749181 20391 raft_consensus.cc:348] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b433e541550a4c4a90bad6341d665114" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44345 } }
I20260808 16:00:45.749394 20391 raft_consensus.cc:374] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:45.749395 20395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:45.738021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49971 (local address 127.0.0.1:44345)
0808 16:00:45.738414 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:45.738429 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:45.738462 (+ 33us) server_negotiation.cc:407] Connection header received
0808 16:00:45.739095 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:45.739111 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:45.739413 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:45.739702 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:45.740505 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:45.741450 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:45.742289 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:45.742736 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:45.742876 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:45.745191 (+ 2315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:45.745196 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:45.745208 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:45.745234 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:45.746722 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:45.747206 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:45.747211 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:45.747215 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:45.747318 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:45.747642 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:45.747644 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:45.747645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:45.747994 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:45.748230 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:45.748533 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 16:00:45.748725 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":112,"threads_started":1}
I20260808 16:00:45.749468 20391 raft_consensus.cc:729] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b433e541550a4c4a90bad6341d665114, State: Initialized, Role: FOLLOWER
I20260808 16:00:45.749914 20391 consensus_queue.cc:260] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b433e541550a4c4a90bad6341d665114" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44345 } }
I20260808 16:00:45.750069 20391 raft_consensus.cc:388] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:45.750133 20391 raft_consensus.cc:482] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:45.750221 20391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:45.751019 20391 raft_consensus.cc:504] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b433e541550a4c4a90bad6341d665114" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44345 } }
I20260808 16:00:45.751358 20391 leader_election.cc:302] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b433e541550a4c4a90bad6341d665114; no voters:
I20260808 16:00:45.751631 20391 leader_election.cc:288] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:00:45.751731 20400 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:45.751906 20400 raft_consensus.cc:686] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [term 1 LEADER]: Becoming Leader. State: Replica: b433e541550a4c4a90bad6341d665114, State: Running, Role: LEADER
I20260808 16:00:45.752204 20400 consensus_queue.cc:237] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b433e541550a4c4a90bad6341d665114" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44345 } }
I20260808 16:00:45.752247 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:00:45.752818 20391 sys_catalog.cc:564] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:45.754511 20402 sys_catalog.cc:455] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b433e541550a4c4a90bad6341d665114. Latest consensus state: current_term: 1 leader_uuid: "b433e541550a4c4a90bad6341d665114" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b433e541550a4c4a90bad6341d665114" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44345 } } }
I20260808 16:00:45.754642 20402 sys_catalog.cc:458] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:45.754945 20401 sys_catalog.cc:455] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b433e541550a4c4a90bad6341d665114" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b433e541550a4c4a90bad6341d665114" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44345 } } }
I20260808 16:00:45.755367 20401 sys_catalog.cc:458] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114 [sys.catalog]: This master's current role is: LEADER
W20260808 16:00:45.757498 20435 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 16:00:45.757571 20435 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 16:00:45.757647 20434 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:45.758442 20434 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:45.763077 20395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:45.754486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57369 (local address 127.0.0.1:44345)
0808 16:00:45.754580 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:45.754584 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:45.754807 (+ 223us) server_negotiation.cc:407] Connection header received
0808 16:00:45.754980 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:45.754983 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:45.755026 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:45.755101 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:45.756115 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:45.756832 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:45.757926 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:45.758237 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:45.758341 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:45.759868 (+ 1527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:45.759871 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:45.759874 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:45.759907 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:45.761170 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:45.761617 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:45.761620 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:45.761622 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:45.761689 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:45.762032 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:45.762035 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:45.762037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:45.762245 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:45.762405 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:45.762674 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 16:00:45.762930 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 16:00:45.763715 20434 catalog_manager.cc:1347] Generated new cluster ID: 644b27b9cc214a258a4542a6215bd06f
I20260808 16:00:45.763765 20434 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:45.775090 20434 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:00:45.775892 20434 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:45.782480 20434 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b433e541550a4c4a90bad6341d665114: Generated new TSK 0
I20260808 16:00:45.783017 20434 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:00:45.795089 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 20286
W20260808 16:00:45.811815 20263 connection.cc:535] client connection to 127.0.0.1:44345 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44345): Connection reset by peer (error 104)
2026-08-08T16:00:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1521 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:00:45 dist-test-slave-lgr5 krb5kdc[20441](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:00:45 dist-test-slave-lgr5 krb5kdc[20441](info): set up 2 sockets
Aug 08 16:00:45 dist-test-slave-lgr5 krb5kdc[20441](info): commencing operation
krb5kdc: starting...
W20260808 16:00:46.970256 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:00:47 dist-test-slave-lgr5 krb5kdc[20441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:00:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:00:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 16:00:47.086594 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42129
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:47.197006 20457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:47.197263 20457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:47.197319 20457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:47.201192 20457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:47.201243 20457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:47.201269 20457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:47.201290 20457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:47.201315 20457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:47.206377 20457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42129
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:47.207360 20457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:47.208352 20457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:47.216383 20471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:47.216419 20468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:47.216419 20467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:47.216495 20457 server_base.cc:1034] running on GCE node
I20260808 16:00:47.217152 20457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:47.218169 20457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:47.219331 20457 hybrid_clock.cc:648] HybridClock initialized: now 1786204847219313 us; error 29 us; skew 500 ppm
Aug 08 16:00:47 dist-test-slave-lgr5 krb5kdc[20441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204847, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:47.221920 20457 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 16:00:47.222734 20457 webserver.cc:460] Webserver started at http://127.0.0.1:43749/ using document root <none> and password file <none>
I20260808 16:00:47.223239 20457 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:47.223304 20457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:47.223495 20457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:47.225452 20457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "d6d3d992e24e4804a3ed9a21de4478f8"
format_stamp: "Formatted at 2026-08-08 16:00:47 on dist-test-slave-lgr5"
server_key: "e9dd072262959831ec95adc9221f3c04"
server_key_iv: "faf286df4b2045a97a5218cd43aac32d"
server_key_version: "encryptionkey@0"
I20260808 16:00:47.225996 20457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "d6d3d992e24e4804a3ed9a21de4478f8"
format_stamp: "Formatted at 2026-08-08 16:00:47 on dist-test-slave-lgr5"
server_key: "e9dd072262959831ec95adc9221f3c04"
server_key_iv: "faf286df4b2045a97a5218cd43aac32d"
server_key_version: "encryptionkey@0"
I20260808 16:00:47.229468 20457 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 16:00:47.231705 20480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:47.232852 20457 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:00:47.232967 20457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "d6d3d992e24e4804a3ed9a21de4478f8"
format_stamp: "Formatted at 2026-08-08 16:00:47 on dist-test-slave-lgr5"
server_key: "e9dd072262959831ec95adc9221f3c04"
server_key_iv: "faf286df4b2045a97a5218cd43aac32d"
server_key_version: "encryptionkey@0"
I20260808 16:00:47.233057 20457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:47.246740 20457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:47.249650 20457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:47.249816 20457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:47.256672 20457 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42129
I20260808 16:00:47.256693 20551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42129 every 8 connection(s)
I20260808 16:00:47.257570 20457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:47.260290 20553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:47.262172 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 20457
I20260808 16:00:47.262303 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:00:47.262588 19828 external_mini_cluster.cc:1428] Setting key c3f72d0848bfb21bc6bf87e30835162e
I20260808 16:00:47.267001 20553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8: Bootstrap starting.
I20260808 16:00:47.269539 20553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:47.270356 20553 log.cc:824] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:47.271939 20557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:47.263903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44165 (local address 127.0.0.1:42129)
0808 16:00:47.264325 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:47.264344 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:47.264386 (+ 42us) server_negotiation.cc:407] Connection header received
0808 16:00:47.265105 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:47.265129 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:47.265549 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:47.265913 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:47.266305 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:47.267704 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:47.268600 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:47.269256 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:47.269408 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:47.270134 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:47.270142 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:47.270158 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:47.270621 (+ 463us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:47.270685 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:47.270719 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:47.270851 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:47.271088 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 16:00:47.271228 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":122,"threads_started":1}
I20260808 16:00:47.272356 20553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8: No bootstrap required, opened a new log
I20260808 16:00:47.274858 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:00:47.276461 20553 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6d3d992e24e4804a3ed9a21de4478f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42129 } }
I20260808 16:00:47.276736 20553 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:47.276806 20553 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3d992e24e4804a3ed9a21de4478f8, State: Initialized, Role: FOLLOWER
I20260808 16:00:47.277230 20553 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6d3d992e24e4804a3ed9a21de4478f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42129 } }
I20260808 16:00:47.277385 20553 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:47.277453 20553 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:47.277558 20553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:47.278360 20553 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6d3d992e24e4804a3ed9a21de4478f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42129 } }
I20260808 16:00:47.278692 20553 leader_election.cc:302] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6d3d992e24e4804a3ed9a21de4478f8; no voters:
I20260808 16:00:47.278972 20553 leader_election.cc:288] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:00:47.279078 20570 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:47.279289 20570 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [term 1 LEADER]: Becoming Leader. State: Replica: d6d3d992e24e4804a3ed9a21de4478f8, State: Running, Role: LEADER
I20260808 16:00:47.279664 20570 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6d3d992e24e4804a3ed9a21de4478f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42129 } }
I20260808 16:00:47.280105 20553 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:47.281306 20572 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6d3d992e24e4804a3ed9a21de4478f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6d3d992e24e4804a3ed9a21de4478f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42129 } } }
I20260808 16:00:47.281421 20572 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:47.281612 20557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:47.277126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55439 (local address 127.0.0.1:42129)
0808 16:00:47.277239 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:47.277243 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:47.277387 (+ 144us) server_negotiation.cc:407] Connection header received
0808 16:00:47.277503 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:47.277505 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:47.277545 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:47.277610 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:47.277876 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:47.278397 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:47.279391 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:47.279708 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:47.279785 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:47.280840 (+ 1055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:47.280844 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:47.280847 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:47.280861 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:47.280891 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:47.280905 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:47.280996 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:47.281452 (+ 456us) server_negotiation.cc:299] Negotiation successful
0808 16:00:47.281486 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 16:00:47.281792 20584 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:47.281756 20573 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6d3d992e24e4804a3ed9a21de4478f8. Latest consensus state: current_term: 1 leader_uuid: "d6d3d992e24e4804a3ed9a21de4478f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6d3d992e24e4804a3ed9a21de4478f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42129 } } }
I20260808 16:00:47.281836 20573 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:47.284664 20584 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:47.289597 20584 catalog_manager.cc:1347] Generated new cluster ID: 890182e21b3e4c98a75f4cea7631bdf1
I20260808 16:00:47.289659 20584 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:47.319207 20584 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:00:47.320269 20584 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:47.326470 20584 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6d3d992e24e4804a3ed9a21de4478f8: Generated new TSK 0
I20260808 16:00:47.327129 20584 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:00:47.336583 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 20457
W20260808 16:00:47.349879 20438 connection.cc:535] client connection to 127.0.0.1:42129 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42129): Connection reset by peer (error 104)
2026-08-08T16:00:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1538 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:00:47 dist-test-slave-lgr5 krb5kdc[20605](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:00:47 dist-test-slave-lgr5 krb5kdc[20605](info): set up 2 sockets
Aug 08 16:00:47 dist-test-slave-lgr5 krb5kdc[20605](info): commencing operation
krb5kdc: starting...
W20260808 16:00:48.504578 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:00:48 dist-test-slave-lgr5 krb5kdc[20605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204848, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:00:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:00:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 16:00:48.619020 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42007
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42007
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:48.725312 20622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:48.725543 20622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:48.725601 20622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:48.729528 20622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:48.729581 20622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:48.729607 20622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:48.729629 20622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:48.729658 20622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:48.734570 20622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42007
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:48.735486 20622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:48.736429 20622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:48.744131 20635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:48.744240 20631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:48.744287 20628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:48.744292 20622 server_base.cc:1034] running on GCE node
I20260808 16:00:48.744939 20622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:48.745901 20622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:48.747076 20622 hybrid_clock.cc:648] HybridClock initialized: now 1786204848747055 us; error 30 us; skew 500 ppm
Aug 08 16:00:48 dist-test-slave-lgr5 krb5kdc[20605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204848, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:48.753654 20622 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 16:00:48.754557 20622 webserver.cc:460] Webserver started at http://127.0.0.1:41161/ using document root <none> and password file <none>
I20260808 16:00:48.755127 20622 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:48.755194 20622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:48.755421 20622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:48.757416 20622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "bf6df2012d794dc6892a1a42f1aa0533"
format_stamp: "Formatted at 2026-08-08 16:00:48 on dist-test-slave-lgr5"
server_key: "780595942a179a7905df2a48de5bacad"
server_key_iv: "813f5d8955581f956bda00aed24b4eb5"
server_key_version: "encryptionkey@0"
I20260808 16:00:48.757946 20622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "bf6df2012d794dc6892a1a42f1aa0533"
format_stamp: "Formatted at 2026-08-08 16:00:48 on dist-test-slave-lgr5"
server_key: "780595942a179a7905df2a48de5bacad"
server_key_iv: "813f5d8955581f956bda00aed24b4eb5"
server_key_version: "encryptionkey@0"
I20260808 16:00:48.761401 20622 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 16:00:48.763537 20644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:48.764693 20622 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:00:48.764812 20622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "bf6df2012d794dc6892a1a42f1aa0533"
format_stamp: "Formatted at 2026-08-08 16:00:48 on dist-test-slave-lgr5"
server_key: "780595942a179a7905df2a48de5bacad"
server_key_iv: "813f5d8955581f956bda00aed24b4eb5"
server_key_version: "encryptionkey@0"
I20260808 16:00:48.764902 20622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:48.769197 20622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:48.771709 20622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:48.771860 20622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:48.778409 20622 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42007
I20260808 16:00:48.778450 20726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42007 every 8 connection(s)
I20260808 16:00:48.779223 20622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:48.781818 20727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:48.784264 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 20622
I20260808 16:00:48.784409 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:00:48.784720 19828 external_mini_cluster.cc:1428] Setting key 522fbfbe003db0532ff50062f4718687
I20260808 16:00:48.787302 20727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533: Bootstrap starting.
I20260808 16:00:48.789368 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:48.785942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40239 (local address 127.0.0.1:42007)
0808 16:00:48.786317 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:48.786331 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:48.786375 (+ 44us) server_negotiation.cc:407] Connection header received
0808 16:00:48.786954 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:48.786970 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:48.787225 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:48.787532 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:48.788251 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:48.788256 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:48.788266 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:48.788276 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:48.788325 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:48.788343 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:48.788475 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:48.788569 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 16:00:48.788702 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":96,"threads_started":1}
I20260808 16:00:48.789628 20727 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:48.790350 20727 log.cc:824] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:48.792021 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:00:48.792356 20727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533: No bootstrap required, opened a new log
I20260808 16:00:48.795396 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:48.793949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46135 (local address 127.0.0.1:42007)
0808 16:00:48.794051 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:48.794055 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:48.794233 (+ 178us) server_negotiation.cc:407] Connection header received
0808 16:00:48.794336 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:48.794340 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:48.794372 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:48.794435 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:48.795045 (+ 610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:48.795048 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:48.795051 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:48.795073 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:48.795097 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:48.795107 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:48.795177 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:48.795263 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 16:00:48.795295 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 16:00:48.795886 20727 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6df2012d794dc6892a1a42f1aa0533" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42007 } }
I20260808 16:00:48.796106 20727 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:48.796205 20727 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf6df2012d794dc6892a1a42f1aa0533, State: Initialized, Role: FOLLOWER
I20260808 16:00:48.796622 20727 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6df2012d794dc6892a1a42f1aa0533" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42007 } }
I20260808 16:00:48.796774 20727 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:48.796838 20727 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:48.796931 20727 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:48.797703 20727 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6df2012d794dc6892a1a42f1aa0533" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42007 } }
I20260808 16:00:48.798003 20727 leader_election.cc:302] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf6df2012d794dc6892a1a42f1aa0533; no voters:
I20260808 16:00:48.798261 20727 leader_election.cc:288] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:00:48.798391 20741 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:48.798583 20741 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [term 1 LEADER]: Becoming Leader. State: Replica: bf6df2012d794dc6892a1a42f1aa0533, State: Running, Role: LEADER
I20260808 16:00:48.798843 20741 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6df2012d794dc6892a1a42f1aa0533" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42007 } }
I20260808 16:00:48.799317 20727 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:48.800383 20748 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf6df2012d794dc6892a1a42f1aa0533" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6df2012d794dc6892a1a42f1aa0533" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42007 } } }
I20260808 16:00:48.800511 20748 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:48.800597 20741 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf6df2012d794dc6892a1a42f1aa0533. Latest consensus state: current_term: 1 leader_uuid: "bf6df2012d794dc6892a1a42f1aa0533" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6df2012d794dc6892a1a42f1aa0533" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42007 } } }
I20260808 16:00:48.800737 20741 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:48.801033 20759 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:48.803676 20759 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:48.808909 20759 catalog_manager.cc:1347] Generated new cluster ID: 8b69bb95080741d8b49eea4a5da7f62c
I20260808 16:00:48.808970 20759 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:48.820467 20759 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:00:48.820767 20759 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:48.830536 20759 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf6df2012d794dc6892a1a42f1aa0533: Generated new TSK 0
I20260808 16:00:48.831274 20759 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:00:48.836208 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 20622
2026-08-08T16:00:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1499 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:00:48 dist-test-slave-lgr5 krb5kdc[20774](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:00:48 dist-test-slave-lgr5 krb5kdc[20774](info): set up 2 sockets
Aug 08 16:00:48 dist-test-slave-lgr5 krb5kdc[20774](info): commencing operation
krb5kdc: starting...
W20260808 16:00:49.983741 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:00:50 dist-test-slave-lgr5 krb5kdc[20774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:00:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:00:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 16:00:50.098471 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34795
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34795
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:50.209549 20792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:50.209789 20792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:50.209829 20792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:50.213776 20792 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:50.213835 20792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:50.213856 20792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:50.213874 20792 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:50.213891 20792 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:50.219233 20792 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:50.220186 20792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:50.221127 20792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:50.229323 20803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:50.229458 20800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:50.229435 20792 server_base.cc:1034] running on GCE node
W20260808 16:00:50.229439 20799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:50.230129 20792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:50.231122 20792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:50.232264 20792 hybrid_clock.cc:648] HybridClock initialized: now 1786204850232237 us; error 41 us; skew 500 ppm
Aug 08 16:00:50 dist-test-slave-lgr5 krb5kdc[20774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204850, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:50.234747 20792 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 16:00:50.235594 20792 webserver.cc:460] Webserver started at http://127.0.0.1:40901/ using document root <none> and password file <none>
I20260808 16:00:50.236132 20792 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:50.236202 20792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:50.236390 20792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:50.238296 20792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "f8fc9a3d885b4816a3fa72070a2ca170"
format_stamp: "Formatted at 2026-08-08 16:00:50 on dist-test-slave-lgr5"
server_key: "17227721946016649e453ae0dd6d755a"
server_key_iv: "814a54c60d3135949e5463635933dcee"
server_key_version: "encryptionkey@0"
I20260808 16:00:50.238821 20792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "f8fc9a3d885b4816a3fa72070a2ca170"
format_stamp: "Formatted at 2026-08-08 16:00:50 on dist-test-slave-lgr5"
server_key: "17227721946016649e453ae0dd6d755a"
server_key_iv: "814a54c60d3135949e5463635933dcee"
server_key_version: "encryptionkey@0"
I20260808 16:00:50.242234 20792 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 16:00:50.244390 20814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:50.245478 20792 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:50.245591 20792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "f8fc9a3d885b4816a3fa72070a2ca170"
format_stamp: "Formatted at 2026-08-08 16:00:50 on dist-test-slave-lgr5"
server_key: "17227721946016649e453ae0dd6d755a"
server_key_iv: "814a54c60d3135949e5463635933dcee"
server_key_version: "encryptionkey@0"
I20260808 16:00:50.245677 20792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:50.268474 20792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:50.271211 20792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:50.271384 20792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:50.278139 20792 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34795
I20260808 16:00:50.278225 20898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34795 every 8 connection(s)
I20260808 16:00:50.279065 20792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:50.281785 20899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:50.284104 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 20792
I20260808 16:00:50.284245 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:00:50.284510 19828 external_mini_cluster.cc:1428] Setting key 3d085d0bbe4a3c4eb46f10caf7475f70
I20260808 16:00:50.287735 20899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170: Bootstrap starting.
I20260808 16:00:50.289906 20899 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:50.290616 20899 log.cc:824] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:50.292542 20899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170: No bootstrap required, opened a new log
Aug 08 16:00:50 dist-test-slave-lgr5 krb5kdc[20774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 16:00:50.295626 20899 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8fc9a3d885b4816a3fa72070a2ca170" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34795 } }
I20260808 16:00:50.295843 20899 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:50.295904 20899 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8fc9a3d885b4816a3fa72070a2ca170, State: Initialized, Role: FOLLOWER
I20260808 16:00:50.296334 20899 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8fc9a3d885b4816a3fa72070a2ca170" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34795 } }
I20260808 16:00:50.296465 20899 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:50.296531 20899 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:50.296627 20899 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:50.297500 20899 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8fc9a3d885b4816a3fa72070a2ca170" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34795 } }
I20260808 16:00:50.297830 20899 leader_election.cc:302] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8fc9a3d885b4816a3fa72070a2ca170; no voters:
I20260808 16:00:50.298123 20899 leader_election.cc:288] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:00:50.298213 20906 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:50.298326 20903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:50.285798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53837 (local address 127.0.0.1:34795)
0808 16:00:50.286246 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:50.286260 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:50.286293 (+ 33us) server_negotiation.cc:407] Connection header received
0808 16:00:50.286920 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:50.286935 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:50.287253 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:50.287550 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:50.288378 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:50.289336 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:50.290204 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:50.290658 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:50.290801 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:50.293318 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:50.293324 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:50.293335 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:50.293360 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:50.295427 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:50.295831 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:50.295837 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:50.295843 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:50.295985 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:50.296302 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:50.296306 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:50.296308 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:50.296768 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:50.296963 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:50.297244 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 16:00:50.297509 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":142,"threads_started":1}
I20260808 16:00:50.298453 20906 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [term 1 LEADER]: Becoming Leader. State: Replica: f8fc9a3d885b4816a3fa72070a2ca170, State: Running, Role: LEADER
I20260808 16:00:50.298933 20906 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8fc9a3d885b4816a3fa72070a2ca170" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34795 } }
I20260808 16:00:50.299393 20899 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:50.300630 20908 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8fc9a3d885b4816a3fa72070a2ca170" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8fc9a3d885b4816a3fa72070a2ca170" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34795 } } }
I20260808 16:00:50.300767 20908 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:50.301718 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:00:50.301806 20909 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8fc9a3d885b4816a3fa72070a2ca170. Latest consensus state: current_term: 1 leader_uuid: "f8fc9a3d885b4816a3fa72070a2ca170" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8fc9a3d885b4816a3fa72070a2ca170" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34795 } } }
I20260808 16:00:50.301882 20909 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170 [sys.catalog]: This master's current role is: LEADER
W20260808 16:00:50.304551 20924 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 16:00:50.304634 20924 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 16:00:50.304704 20918 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:50.305620 20918 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:50.312332 20918 catalog_manager.cc:1347] Generated new cluster ID: 895eef0c55a048dd9a88fae4565b3697
I20260808 16:00:50.312389 20918 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:50.312638 20903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:50.303876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59721 (local address 127.0.0.1:34795)
0808 16:00:50.303985 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:50.303989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:50.304381 (+ 392us) server_negotiation.cc:407] Connection header received
0808 16:00:50.304515 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:50.304519 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:50.304570 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:50.304661 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:50.305481 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:50.306031 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:50.307108 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:50.307425 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:50.307497 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:50.309490 (+ 1993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:50.309494 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:50.309496 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:50.309521 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:50.311018 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:50.311399 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:50.311402 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:50.311404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:50.311480 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:50.311724 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:50.311727 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:50.311729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:50.311898 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:50.312004 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:50.312376 (+ 372us) server_negotiation.cc:299] Negotiation successful
0808 16:00:50.312488 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 16:00:50.323632 20918 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:00:50.324774 20918 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:50.331568 20918 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8fc9a3d885b4816a3fa72070a2ca170: Generated new TSK 0
I20260808 16:00:50.332295 20918 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:00:50.338465 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 20792
2026-08-08T16:00:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1501 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:00:50 dist-test-slave-lgr5 krb5kdc[20945](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:00:50 dist-test-slave-lgr5 krb5kdc[20945](info): set up 2 sockets
Aug 08 16:00:50 dist-test-slave-lgr5 krb5kdc[20945](info): commencing operation
krb5kdc: starting...
W20260808 16:00:51.482446 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:00:51 dist-test-slave-lgr5 krb5kdc[20945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204851, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:00:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:00:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 16:00:51.595934 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41865
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41865
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:51.701043 20965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:51.701267 20965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:51.701320 20965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:51.705225 20965 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:51.705279 20965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:51.705304 20965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:51.705324 20965 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:51.705353 20965 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:51.710276 20965 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41865
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:51.711148 20965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:51.712039 20965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:51.719691 20973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:51.719683 20977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:51.719818 20965 server_base.cc:1034] running on GCE node
W20260808 16:00:51.719784 20982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:51.720570 20965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:51.721546 20965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:51.722693 20965 hybrid_clock.cc:648] HybridClock initialized: now 1786204851722672 us; error 34 us; skew 500 ppm
Aug 08 16:00:51 dist-test-slave-lgr5 krb5kdc[20945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204851, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:51.725149 20965 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 16:00:51.725919 20965 webserver.cc:460] Webserver started at http://127.0.0.1:42939/ using document root <none> and password file <none>
I20260808 16:00:51.726423 20965 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:51.726486 20965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:51.726676 20965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:51.728603 20965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "7b594454bbc048a188152e13809c3be5"
format_stamp: "Formatted at 2026-08-08 16:00:51 on dist-test-slave-lgr5"
server_key: "b099ee6264fbab2385135ad0966daf06"
server_key_iv: "d2dfe923e5c0bd6f02641aca24ee082d"
server_key_version: "encryptionkey@0"
I20260808 16:00:51.729118 20965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "7b594454bbc048a188152e13809c3be5"
format_stamp: "Formatted at 2026-08-08 16:00:51 on dist-test-slave-lgr5"
server_key: "b099ee6264fbab2385135ad0966daf06"
server_key_iv: "d2dfe923e5c0bd6f02641aca24ee082d"
server_key_version: "encryptionkey@0"
I20260808 16:00:51.732478 20965 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 16:00:51.734634 20993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:51.735720 20965 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:00:51.735841 20965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "7b594454bbc048a188152e13809c3be5"
format_stamp: "Formatted at 2026-08-08 16:00:51 on dist-test-slave-lgr5"
server_key: "b099ee6264fbab2385135ad0966daf06"
server_key_iv: "d2dfe923e5c0bd6f02641aca24ee082d"
server_key_version: "encryptionkey@0"
I20260808 16:00:51.735929 20965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:51.758229 20965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:51.761045 20965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:51.761207 20965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:51.767402 20965 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41865
I20260808 16:00:51.767434 21077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41865 every 8 connection(s)
I20260808 16:00:51.768249 20965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:51.770762 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 20965
I20260808 16:00:51.770905 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:00:51.770984 21078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:51.771222 19828 external_mini_cluster.cc:1428] Setting key 9ab3c4484ed18109af3970fabc47852c
I20260808 16:00:51.777581 21078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5: Bootstrap starting.
I20260808 16:00:51.779598 21083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:51.772460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35783 (local address 127.0.0.1:41865)
0808 16:00:51.772830 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:51.772844 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:51.772879 (+ 35us) server_negotiation.cc:407] Connection header received
0808 16:00:51.773617 (+ 738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:51.773635 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:51.773938 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:51.774187 (+ 249us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:51.774543 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:51.775508 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:51.776726 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:51.777168 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:51.777284 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:51.778075 (+ 791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:51.778080 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:51.778090 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:51.778446 (+ 356us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:51.778498 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:51.778520 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:51.778589 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:51.778738 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 16:00:51.778912 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":108,"threads_started":1}
I20260808 16:00:51.779819 21078 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:51.780579 21078 log.cc:824] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:51.782243 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:00:51.782545 21078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5: No bootstrap required, opened a new log
I20260808 16:00:51.786046 21078 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b594454bbc048a188152e13809c3be5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41865 } }
I20260808 16:00:51.786248 21078 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:51.786315 21078 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b594454bbc048a188152e13809c3be5, State: Initialized, Role: FOLLOWER
I20260808 16:00:51.786687 21078 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b594454bbc048a188152e13809c3be5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41865 } }
I20260808 16:00:51.786801 21078 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:51.786857 21078 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:51.786944 21078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:51.787326 21083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:51.784012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37633 (local address 127.0.0.1:41865)
0808 16:00:51.784135 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:51.784139 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:51.784286 (+ 147us) server_negotiation.cc:407] Connection header received
0808 16:00:51.784395 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:51.784398 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:51.784439 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:51.784500 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:51.784733 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:51.785184 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:51.785937 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:51.786134 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:51.786217 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:51.786938 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:51.786942 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:51.786945 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:51.786957 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:51.786981 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:51.786993 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:51.787052 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:51.787154 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 16:00:51.787210 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 16:00:51.787886 21078 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b594454bbc048a188152e13809c3be5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41865 } }
I20260808 16:00:51.788251 21078 leader_election.cc:302] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b594454bbc048a188152e13809c3be5; no voters:
I20260808 16:00:51.788520 21078 leader_election.cc:288] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:00:51.788609 21093 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:51.788800 21093 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [term 1 LEADER]: Becoming Leader. State: Replica: 7b594454bbc048a188152e13809c3be5, State: Running, Role: LEADER
I20260808 16:00:51.789081 21093 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b594454bbc048a188152e13809c3be5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41865 } }
I20260808 16:00:51.789625 21078 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:51.790745 21095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b594454bbc048a188152e13809c3be5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b594454bbc048a188152e13809c3be5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41865 } } }
I20260808 16:00:51.790786 21099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b594454bbc048a188152e13809c3be5. Latest consensus state: current_term: 1 leader_uuid: "7b594454bbc048a188152e13809c3be5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b594454bbc048a188152e13809c3be5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41865 } } }
I20260808 16:00:51.790870 21095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:51.790881 21099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:51.791213 21109 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:51.793768 21109 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:51.798753 21109 catalog_manager.cc:1347] Generated new cluster ID: 04f912636ae0469a9670e852939a468f
I20260808 16:00:51.798800 21109 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:51.809471 21109 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:00:51.810591 21109 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:51.817431 21109 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b594454bbc048a188152e13809c3be5: Generated new TSK 0
I20260808 16:00:51.818107 21109 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:00:51.828696 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 20965
2026-08-08T16:00:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1496 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:00:51 dist-test-slave-lgr5 krb5kdc[21129](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:00:51 dist-test-slave-lgr5 krb5kdc[21129](info): set up 2 sockets
Aug 08 16:00:51 dist-test-slave-lgr5 krb5kdc[21129](info): commencing operation
krb5kdc: starting...
W20260808 16:00:53.030032 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:00:53 dist-test-slave-lgr5 krb5kdc[21129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204853, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:00:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:00:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 16:00:53.144761 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37199
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37199
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:53.251899 21153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:53.252157 21153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:53.252202 21153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:53.256057 21153 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:53.256124 21153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:53.256141 21153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:53.256160 21153 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:53.256187 21153 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:53.261494 21153 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37199
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:53.262447 21153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:53.263388 21153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:53.271347 21165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:53.271430 21161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:53.271431 21160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:53.271696 21153 server_base.cc:1034] running on GCE node
I20260808 16:00:53.272234 21153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:53.273226 21153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:53.274408 21153 hybrid_clock.cc:648] HybridClock initialized: now 1786204853274382 us; error 36 us; skew 500 ppm
Aug 08 16:00:53 dist-test-slave-lgr5 krb5kdc[21129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204853, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:53.277079 21153 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 16:00:53.277925 21153 webserver.cc:460] Webserver started at http://127.0.0.1:40101/ using document root <none> and password file <none>
I20260808 16:00:53.278434 21153 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:53.278499 21153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:53.278690 21153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:53.280709 21153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "44fdda886edf4d4aad7afceeceecf424"
format_stamp: "Formatted at 2026-08-08 16:00:53 on dist-test-slave-lgr5"
server_key: "cb7fc859c47ec3cf01161cff443c79f1"
server_key_iv: "7816c7df1c5c2a68f2c64cf95f0d1be6"
server_key_version: "encryptionkey@0"
I20260808 16:00:53.281234 21153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "44fdda886edf4d4aad7afceeceecf424"
format_stamp: "Formatted at 2026-08-08 16:00:53 on dist-test-slave-lgr5"
server_key: "cb7fc859c47ec3cf01161cff443c79f1"
server_key_iv: "7816c7df1c5c2a68f2c64cf95f0d1be6"
server_key_version: "encryptionkey@0"
I20260808 16:00:53.284789 21153 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 16:00:53.287014 21172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:53.288157 21153 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:00:53.288266 21153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "44fdda886edf4d4aad7afceeceecf424"
format_stamp: "Formatted at 2026-08-08 16:00:53 on dist-test-slave-lgr5"
server_key: "cb7fc859c47ec3cf01161cff443c79f1"
server_key_iv: "7816c7df1c5c2a68f2c64cf95f0d1be6"
server_key_version: "encryptionkey@0"
I20260808 16:00:53.288354 21153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:53.292733 21153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:53.295534 21153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:53.295689 21153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:53.302243 21153 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37199
I20260808 16:00:53.302260 21253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37199 every 8 connection(s)
I20260808 16:00:53.303076 21153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:53.305773 21254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:53.309919 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 21153
I20260808 16:00:53.310053 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:00:53.310343 19828 external_mini_cluster.cc:1428] Setting key e155e273ee54e9e52b3c36d56e1653db
I20260808 16:00:53.311290 21254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424: Bootstrap starting.
I20260808 16:00:53.313474 21254 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:53.314340 21254 log.cc:824] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:53.315194 21259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:53.311622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50173 (local address 127.0.0.1:37199)
0808 16:00:53.312012 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:53.312025 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:53.312059 (+ 34us) server_negotiation.cc:407] Connection header received
0808 16:00:53.312721 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:53.312737 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:53.312995 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:53.313253 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:53.314055 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:53.314060 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:53.314071 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:53.314081 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:53.314132 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:53.314151 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:53.314228 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:53.314358 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 16:00:53.314520 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":95,"threads_started":1}
I20260808 16:00:53.316206 21254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424: No bootstrap required, opened a new log
I20260808 16:00:53.318100 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:00:53.320578 21254 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44fdda886edf4d4aad7afceeceecf424" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37199 } }
I20260808 16:00:53.320787 21254 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:53.320832 21254 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44fdda886edf4d4aad7afceeceecf424, State: Initialized, Role: FOLLOWER
I20260808 16:00:53.321215 21254 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44fdda886edf4d4aad7afceeceecf424" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37199 } }
I20260808 16:00:53.321332 21254 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:53.321390 21254 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:53.321482 21254 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:53.322285 21254 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44fdda886edf4d4aad7afceeceecf424" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37199 } }
I20260808 16:00:53.322589 21254 leader_election.cc:302] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44fdda886edf4d4aad7afceeceecf424; no voters:
I20260808 16:00:53.322844 21254 leader_election.cc:288] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:00:53.322937 21272 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:53.323160 21272 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [term 1 LEADER]: Becoming Leader. State: Replica: 44fdda886edf4d4aad7afceeceecf424, State: Running, Role: LEADER
I20260808 16:00:53.323529 21272 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44fdda886edf4d4aad7afceeceecf424" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37199 } }
I20260808 16:00:53.323983 21254 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:53.325126 21273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44fdda886edf4d4aad7afceeceecf424" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44fdda886edf4d4aad7afceeceecf424" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37199 } } }
I20260808 16:00:53.325121 21276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44fdda886edf4d4aad7afceeceecf424. Latest consensus state: current_term: 1 leader_uuid: "44fdda886edf4d4aad7afceeceecf424" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44fdda886edf4d4aad7afceeceecf424" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37199 } } }
I20260808 16:00:53.325258 21276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:53.325258 21273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:53.325654 21292 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:53.327661 21259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:53.320201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58493 (local address 127.0.0.1:37199)
0808 16:00:53.320300 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:53.320304 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:53.326337 (+ 6033us) server_negotiation.cc:407] Connection header received
0808 16:00:53.326488 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:53.326491 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:53.326525 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:53.326611 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:53.327260 (+ 649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:53.327263 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:53.327266 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:53.327278 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:53.327302 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:53.327312 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:53.327388 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:53.327515 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 16:00:53.327550 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 16:00:53.328862 21292 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:53.333961 21292 catalog_manager.cc:1347] Generated new cluster ID: 9ddbdc1987404002854c4899f3966446
I20260808 16:00:53.334028 21292 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:53.358240 21292 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:00:53.358567 21292 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:53.365063 21292 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44fdda886edf4d4aad7afceeceecf424: Generated new TSK 0
I20260808 16:00:53.365723 21292 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:00:53.376216 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 21153
2026-08-08T16:00:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1542 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:00:53 dist-test-slave-lgr5 krb5kdc[21306](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:00:53 dist-test-slave-lgr5 krb5kdc[21306](info): set up 2 sockets
Aug 08 16:00:53 dist-test-slave-lgr5 krb5kdc[21306](info): commencing operation
krb5kdc: starting...
W20260808 16:00:54.534953 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:00:54 dist-test-slave-lgr5 krb5kdc[21306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:00:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:00:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 16:00:54.650161 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40265
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:54.756214 21325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:54.756443 21325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:54.756500 21325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:54.760368 21325 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:54.760418 21325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:54.760443 21325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:54.760465 21325 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:54.760494 21325 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:54.765385 21325 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40265
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:54.766276 21325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:54.767204 21325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:54.775022 21333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:54.775017 21332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:54.775084 21336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:54.775219 21325 server_base.cc:1034] running on GCE node
I20260808 16:00:54.775858 21325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:54.776871 21325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:54.778018 21325 hybrid_clock.cc:648] HybridClock initialized: now 1786204854777999 us; error 37 us; skew 500 ppm
Aug 08 16:00:54 dist-test-slave-lgr5 krb5kdc[21306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204854, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:54.783604 21325 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 16:00:54.784441 21325 webserver.cc:460] Webserver started at http://127.0.0.1:45727/ using document root <none> and password file <none>
I20260808 16:00:54.784940 21325 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:54.785004 21325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:54.785180 21325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:54.787050 21325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "8c178c58d613405aa718c0187700090d"
format_stamp: "Formatted at 2026-08-08 16:00:54 on dist-test-slave-lgr5"
server_key: "ef0f16f8251dcaff080c66de0d6cc66b"
server_key_iv: "1ced1c1c9275ffad3e49b605bfeab601"
server_key_version: "encryptionkey@0"
I20260808 16:00:54.787585 21325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "8c178c58d613405aa718c0187700090d"
format_stamp: "Formatted at 2026-08-08 16:00:54 on dist-test-slave-lgr5"
server_key: "ef0f16f8251dcaff080c66de0d6cc66b"
server_key_iv: "1ced1c1c9275ffad3e49b605bfeab601"
server_key_version: "encryptionkey@0"
I20260808 16:00:54.791039 21325 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 16:00:54.793236 21350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:54.794335 21325 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 16:00:54.794447 21325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "8c178c58d613405aa718c0187700090d"
format_stamp: "Formatted at 2026-08-08 16:00:54 on dist-test-slave-lgr5"
server_key: "ef0f16f8251dcaff080c66de0d6cc66b"
server_key_iv: "1ced1c1c9275ffad3e49b605bfeab601"
server_key_version: "encryptionkey@0"
I20260808 16:00:54.794533 21325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:54.811767 21325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:54.814620 21325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:54.814780 21325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:54.821247 21325 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40265
I20260808 16:00:54.821265 21437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40265 every 8 connection(s)
I20260808 16:00:54.822110 21325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:54.824734 21438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:54.825338 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 21325
I20260808 16:00:54.825495 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:00:54.825809 19828 external_mini_cluster.cc:1428] Setting key c5253cd20f37e0d522264cf42746ec41
I20260808 16:00:54.830725 21438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d: Bootstrap starting.
I20260808 16:00:54.833211 21438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:54.834051 21438 log.cc:824] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d: Log is configured to *not* fsync() on all Append() calls
Aug 08 16:00:54 dist-test-slave-lgr5 krb5kdc[21306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 16:00:54.835809 21438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d: No bootstrap required, opened a new log
I20260808 16:00:54.839102 21444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:54.827074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:57771 (local address 127.0.0.1:40265)
0808 16:00:54.827452 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:54.827466 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:54.827501 (+ 35us) server_negotiation.cc:407] Connection header received
0808 16:00:54.828175 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:54.828194 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:54.828512 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:54.828773 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:54.829653 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:54.830582 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:54.831711 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:54.832206 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:54.832325 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:54.834918 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:54.834922 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:54.834934 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:54.834958 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:54.836516 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:54.837021 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:54.837025 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:54.837029 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:54.837137 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:54.837439 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:54.837441 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:54.837442 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:54.837779 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:54.837916 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:54.838228 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 16:00:54.838414 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":112,"threads_started":1}
I20260808 16:00:54.839541 21438 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c178c58d613405aa718c0187700090d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40265 } }
I20260808 16:00:54.839802 21438 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:54.839857 21438 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c178c58d613405aa718c0187700090d, State: Initialized, Role: FOLLOWER
I20260808 16:00:54.840294 21438 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c178c58d613405aa718c0187700090d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40265 } }
I20260808 16:00:54.840435 21438 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:54.840499 21438 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:54.840595 21438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:54.841536 21438 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c178c58d613405aa718c0187700090d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40265 } }
I20260808 16:00:54.841862 21438 leader_election.cc:302] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c178c58d613405aa718c0187700090d; no voters:
I20260808 16:00:54.841986 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:00:54.842175 21438 leader_election.cc:288] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:00:54.842268 21446 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:54.842465 21446 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [term 1 LEADER]: Becoming Leader. State: Replica: 8c178c58d613405aa718c0187700090d, State: Running, Role: LEADER
I20260808 16:00:54.842826 21446 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c178c58d613405aa718c0187700090d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40265 } }
I20260808 16:00:54.843241 21438 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:54.844053 21446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c178c58d613405aa718c0187700090d. Latest consensus state: current_term: 1 leader_uuid: "8c178c58d613405aa718c0187700090d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c178c58d613405aa718c0187700090d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40265 } } }
I20260808 16:00:54.844250 21446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:54.844471 21448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c178c58d613405aa718c0187700090d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c178c58d613405aa718c0187700090d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40265 } } }
I20260808 16:00:54.844568 21448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d [sys.catalog]: This master's current role is: LEADER
W20260808 16:00:54.847867 21476 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 16:00:54.847954 21476 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 16:00:54.848014 21465 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:54.848853 21465 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:54.852466 21444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:54.844116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:52911 (local address 127.0.0.1:40265)
0808 16:00:54.844214 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:54.844218 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:54.845419 (+ 1201us) server_negotiation.cc:407] Connection header received
0808 16:00:54.845579 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:54.845582 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:54.845625 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:54.845698 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:54.846548 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:54.847035 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:54.847813 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:54.848127 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:54.848248 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:54.849444 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:54.849448 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:54.849450 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:54.849474 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:54.850803 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:54.851227 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:54.851230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:54.851232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:54.851306 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:54.851605 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:54.851608 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:54.851610 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:54.851768 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:54.851889 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:54.852231 (+ 342us) server_negotiation.cc:299] Negotiation successful
0808 16:00:54.852326 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 16:00:54.857280 21465 catalog_manager.cc:1347] Generated new cluster ID: e8c08eda372241c8a0f9c8baabdc2359
I20260808 16:00:54.857342 21465 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:54.885591 21465 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:00:54.886400 21465 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:54.891112 21465 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c178c58d613405aa718c0187700090d: Generated new TSK 0
I20260808 16:00:54.891688 21465 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:00:54.903831 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 21325
W20260808 16:00:54.919445 21304 connection.cc:535] client connection to 127.0.0.1:40265 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40265): Connection reset by peer (error 104)
2026-08-08T16:00:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1528 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:00:54 dist-test-slave-lgr5 krb5kdc[21487](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:00:54 dist-test-slave-lgr5 krb5kdc[21487](info): set up 2 sockets
Aug 08 16:00:54 dist-test-slave-lgr5 krb5kdc[21487](info): commencing operation
krb5kdc: starting...
W20260808 16:00:56.053336 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:00:56 dist-test-slave-lgr5 krb5kdc[21487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204856, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:00:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:00:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 16:00:56.168895 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40293
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:56.275452 21506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:56.275698 21506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:56.275754 21506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:56.279610 21506 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:56.279662 21506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:56.279688 21506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:56.279711 21506 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:56.279738 21506 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:56.284704 21506 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:56.285624 21506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:56.286553 21506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:56.294447 21513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:56.294598 21506 server_base.cc:1034] running on GCE node
W20260808 16:00:56.294461 21515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:56.294473 21512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:56.295233 21506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:56.296267 21506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:56.297422 21506 hybrid_clock.cc:648] HybridClock initialized: now 1786204856297410 us; error 30 us; skew 500 ppm
Aug 08 16:00:56 dist-test-slave-lgr5 krb5kdc[21487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204856, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:56.299988 21506 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 16:00:56.300801 21506 webserver.cc:460] Webserver started at http://127.0.0.1:39145/ using document root <none> and password file <none>
I20260808 16:00:56.301295 21506 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:56.301358 21506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:56.301560 21506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:56.303449 21506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "511d4c33dcdc4950b0bec802720d9248"
format_stamp: "Formatted at 2026-08-08 16:00:56 on dist-test-slave-lgr5"
server_key: "e957380006bb330cb90257adc2e53349"
server_key_iv: "df09b82741d1ce115b929c5a3ca3dcd3"
server_key_version: "encryptionkey@0"
I20260808 16:00:56.303994 21506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "511d4c33dcdc4950b0bec802720d9248"
format_stamp: "Formatted at 2026-08-08 16:00:56 on dist-test-slave-lgr5"
server_key: "e957380006bb330cb90257adc2e53349"
server_key_iv: "df09b82741d1ce115b929c5a3ca3dcd3"
server_key_version: "encryptionkey@0"
I20260808 16:00:56.307392 21506 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 16:00:56.309649 21527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:56.310781 21506 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 16:00:56.310891 21506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "511d4c33dcdc4950b0bec802720d9248"
format_stamp: "Formatted at 2026-08-08 16:00:56 on dist-test-slave-lgr5"
server_key: "e957380006bb330cb90257adc2e53349"
server_key_iv: "df09b82741d1ce115b929c5a3ca3dcd3"
server_key_version: "encryptionkey@0"
I20260808 16:00:56.310979 21506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:56.343200 21506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:56.346304 21506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:56.346486 21506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:56.353168 21506 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40293
I20260808 16:00:56.353226 21614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40293 every 8 connection(s)
I20260808 16:00:56.354127 21506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:56.356871 21616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:56.362273 21616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248: Bootstrap starting.
I20260808 16:00:56.364295 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 21506
I20260808 16:00:56.364426 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:00:56.364634 21616 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:56.364670 19828 external_mini_cluster.cc:1428] Setting key c37d122a2c91192693287d87e8cf1963
I20260808 16:00:56.365451 21616 log.cc:824] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:56.367312 21616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248: No bootstrap required, opened a new log
I20260808 16:00:56.371245 21616 raft_consensus.cc:348] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511d4c33dcdc4950b0bec802720d9248" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40293 } }
I20260808 16:00:56.371485 21616 raft_consensus.cc:374] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:56.371526 21616 raft_consensus.cc:729] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511d4c33dcdc4950b0bec802720d9248, State: Initialized, Role: FOLLOWER
I20260808 16:00:56.371912 21616 consensus_queue.cc:260] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511d4c33dcdc4950b0bec802720d9248" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40293 } }
I20260808 16:00:56.372063 21616 raft_consensus.cc:388] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:56.372156 21616 raft_consensus.cc:482] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:56.372258 21616 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:56.373050 21616 raft_consensus.cc:504] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511d4c33dcdc4950b0bec802720d9248" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40293 } }
I20260808 16:00:56.373072 21623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:56.365698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:58981 (local address 127.0.0.1:40293)
0808 16:00:56.366126 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:56.366145 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:56.366188 (+ 43us) server_negotiation.cc:407] Connection header received
0808 16:00:56.366801 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:56.366818 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:56.367135 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:56.367408 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:56.367746 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:56.368705 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:56.369940 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:56.370389 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:56.370499 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:56.371348 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:56.371353 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:56.371364 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:56.371776 (+ 412us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:56.371837 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:56.371862 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:56.371961 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:56.372246 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 16:00:56.372381 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":127,"threads_started":1}
I20260808 16:00:56.373391 21616 leader_election.cc:302] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 511d4c33dcdc4950b0bec802720d9248; no voters:
I20260808 16:00:56.373682 21616 leader_election.cc:288] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:00:56.373754 21624 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:56.373934 21624 raft_consensus.cc:686] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [term 1 LEADER]: Becoming Leader. State: Replica: 511d4c33dcdc4950b0bec802720d9248, State: Running, Role: LEADER
I20260808 16:00:56.374287 21624 consensus_queue.cc:237] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511d4c33dcdc4950b0bec802720d9248" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40293 } }
I20260808 16:00:56.374732 21616 sys_catalog.cc:564] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:56.375447 21626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 511d4c33dcdc4950b0bec802720d9248. Latest consensus state: current_term: 1 leader_uuid: "511d4c33dcdc4950b0bec802720d9248" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511d4c33dcdc4950b0bec802720d9248" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40293 } } }
I20260808 16:00:56.375567 21626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:56.376026 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:00:56.376293 21625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "511d4c33dcdc4950b0bec802720d9248" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511d4c33dcdc4950b0bec802720d9248" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40293 } } }
I20260808 16:00:56.376379 21625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248 [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:56.376636 21636 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:56.379410 21636 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:56.382800 21623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:56.378225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:60379 (local address 127.0.0.1:40293)
0808 16:00:56.378318 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:56.378322 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:56.378541 (+ 219us) server_negotiation.cc:407] Connection header received
0808 16:00:56.378709 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:56.378712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:56.378754 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:56.378798 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:56.379208 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:56.379931 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:56.381093 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:56.381406 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:56.381509 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:56.382339 (+ 830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:56.382343 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:56.382346 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:56.382358 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:56.382390 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:56.382403 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:56.382485 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:56.382648 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 16:00:56.382682 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 16:00:56.384651 21636 catalog_manager.cc:1347] Generated new cluster ID: 1915d7779d674b16a455f4b4cfce1314
I20260808 16:00:56.384704 21636 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:56.393818 21636 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:00:56.394649 21636 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:56.405274 21636 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 511d4c33dcdc4950b0bec802720d9248: Generated new TSK 0
I20260808 16:00:56.405911 21636 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:00:56.416963 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 21506
W20260808 16:00:56.425602 21480 connection.cc:535] client connection to 127.0.0.1:40293 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40293): Connection reset by peer (error 104)
2026-08-08T16:00:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1506 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:00:56 dist-test-slave-lgr5 krb5kdc[21659](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:00:56 dist-test-slave-lgr5 krb5kdc[21659](info): set up 2 sockets
Aug 08 16:00:56 dist-test-slave-lgr5 krb5kdc[21659](info): commencing operation
krb5kdc: starting...
W20260808 16:00:57.574656 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:00:57 dist-test-slave-lgr5 krb5kdc[21659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:00:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:00:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 16:00:57.688410 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36867
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36867
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:57.794260 21683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:57.794493 21683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:57.794555 21683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:57.798472 21683 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:57.798528 21683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:57.798563 21683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:57.798585 21683 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:57.798614 21683 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:57.803610 21683 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36867
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:57.804535 21683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:57.805459 21683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:57.813427 21691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:57.813467 21694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:57.813578 21683 server_base.cc:1034] running on GCE node
W20260808 16:00:57.813793 21696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:57.814306 21683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:57.815400 21683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:57.816566 21683 hybrid_clock.cc:648] HybridClock initialized: now 1786204857816545 us; error 31 us; skew 500 ppm
Aug 08 16:00:57 dist-test-slave-lgr5 krb5kdc[21659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204857, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:57.819244 21683 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 16:00:57.820106 21683 webserver.cc:460] Webserver started at http://127.0.0.1:43265/ using document root <none> and password file <none>
I20260808 16:00:57.820626 21683 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:57.820693 21683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:57.820890 21683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:57.822805 21683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "aa57614c6559420aa32affb2a257e96e"
format_stamp: "Formatted at 2026-08-08 16:00:57 on dist-test-slave-lgr5"
server_key: "d6290594acbea73030bc5a2f95cc3a35"
server_key_iv: "8d0ecb1a9638ba37f9cc593d6f0a1615"
server_key_version: "encryptionkey@0"
I20260808 16:00:57.823355 21683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "aa57614c6559420aa32affb2a257e96e"
format_stamp: "Formatted at 2026-08-08 16:00:57 on dist-test-slave-lgr5"
server_key: "d6290594acbea73030bc5a2f95cc3a35"
server_key_iv: "8d0ecb1a9638ba37f9cc593d6f0a1615"
server_key_version: "encryptionkey@0"
I20260808 16:00:57.826830 21683 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 16:00:57.829134 21708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:57.830284 21683 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 16:00:57.830394 21683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "aa57614c6559420aa32affb2a257e96e"
format_stamp: "Formatted at 2026-08-08 16:00:57 on dist-test-slave-lgr5"
server_key: "d6290594acbea73030bc5a2f95cc3a35"
server_key_iv: "8d0ecb1a9638ba37f9cc593d6f0a1615"
server_key_version: "encryptionkey@0"
I20260808 16:00:57.830483 21683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:57.834853 21683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:57.837733 21683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:57.837894 21683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:57.844230 21683 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36867
I20260808 16:00:57.844246 21791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36867 every 8 connection(s)
I20260808 16:00:57.845052 21683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:57.847545 21792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:57.852649 21792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e: Bootstrap starting.
I20260808 16:00:57.853560 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 21683
I20260808 16:00:57.853693 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:00:57.853935 19828 external_mini_cluster.cc:1428] Setting key fc032fbe86948d1a1a967005bfe6101f
I20260808 16:00:57.855123 21792 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:57.855791 21792 log.cc:824] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:57.857838 21792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e: No bootstrap required, opened a new log
I20260808 16:00:57.858462 21797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:57.854889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:53555 (local address 127.0.0.1:36867)
0808 16:00:57.855277 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:57.855291 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:57.855324 (+ 33us) server_negotiation.cc:407] Connection header received
0808 16:00:57.855927 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:57.855950 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:57.856289 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:57.856619 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:57.857342 (+ 723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:57.857347 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:57.857357 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:57.857367 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:57.857413 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:57.857431 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:57.857511 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:57.857638 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 16:00:57.857776 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":110,"threads_started":1}
I20260808 16:00:57.861132 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:00:57.861752 21792 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa57614c6559420aa32affb2a257e96e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36867 } }
I20260808 16:00:57.862017 21792 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:57.862078 21792 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa57614c6559420aa32affb2a257e96e, State: Initialized, Role: FOLLOWER
I20260808 16:00:57.862519 21792 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa57614c6559420aa32affb2a257e96e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36867 } }
I20260808 16:00:57.862682 21792 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:57.862752 21792 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:57.862848 21792 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:57.863806 21792 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa57614c6559420aa32affb2a257e96e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36867 } }
I20260808 16:00:57.864172 21792 leader_election.cc:302] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa57614c6559420aa32affb2a257e96e; no voters:
I20260808 16:00:57.864468 21792 leader_election.cc:288] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:00:57.864506 21809 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:57.864835 21797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:57.863327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:40615 (local address 127.0.0.1:36867)
0808 16:00:57.863442 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:57.863446 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:57.863625 (+ 179us) server_negotiation.cc:407] Connection header received
0808 16:00:57.863703 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:57.863706 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:57.863737 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:57.863821 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:57.864423 (+ 602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:57.864426 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:57.864428 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:00:57.864440 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:57.864465 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:00:57.864477 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:57.864562 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:57.864678 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 16:00:57.864716 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 16:00:57.864728 21809 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [term 1 LEADER]: Becoming Leader. State: Replica: aa57614c6559420aa32affb2a257e96e, State: Running, Role: LEADER
I20260808 16:00:57.865170 21809 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa57614c6559420aa32affb2a257e96e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36867 } }
I20260808 16:00:57.865669 21792 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:57.866259 21809 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa57614c6559420aa32affb2a257e96e. Latest consensus state: current_term: 1 leader_uuid: "aa57614c6559420aa32affb2a257e96e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa57614c6559420aa32affb2a257e96e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36867 } } }
I20260808 16:00:57.866415 21809 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:57.866647 21809 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa57614c6559420aa32affb2a257e96e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa57614c6559420aa32affb2a257e96e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36867 } } }
I20260808 16:00:57.866770 21825 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:57.866782 21809 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:57.869616 21825 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:57.874625 21825 catalog_manager.cc:1347] Generated new cluster ID: 184937b7f9bf41c6803f7f58119f7547
I20260808 16:00:57.874684 21825 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:57.911350 21825 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:00:57.911689 21825 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:57.917241 21825 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa57614c6559420aa32affb2a257e96e: Generated new TSK 0
I20260808 16:00:57.917852 21825 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:00:57.930400 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 21683
2026-08-08T16:00:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1526 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:00:58 dist-test-slave-lgr5 krb5kdc[21846](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:00:58 dist-test-slave-lgr5 krb5kdc[21846](info): set up 2 sockets
Aug 08 16:00:58 dist-test-slave-lgr5 krb5kdc[21846](info): commencing operation
krb5kdc: starting...
W20260808 16:00:59.090590 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:00:59 dist-test-slave-lgr5 krb5kdc[21846](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:00:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:00:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 16:00:59.204959 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43317
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43317
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:00:59.315142 21873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:00:59.315369 21873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:00:59.315435 21873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:00:59.319370 21873 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:00:59.319432 21873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:00:59.319459 21873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:00:59.319480 21873 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:00:59.319516 21873 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:00:59.324663 21873 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43317
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:00:59.325655 21873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:00:59.326642 21873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:00:59.334709 21884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:59.334717 21882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:00:59.334754 21887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:00:59.335034 21873 server_base.cc:1034] running on GCE node
I20260808 16:00:59.335577 21873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:00:59.336653 21873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:00:59.337821 21873 hybrid_clock.cc:648] HybridClock initialized: now 1786204859337803 us; error 25 us; skew 500 ppm
Aug 08 16:00:59 dist-test-slave-lgr5 krb5kdc[21846](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204859, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:00:59.340906 21873 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 16:00:59.341701 21873 webserver.cc:460] Webserver started at http://127.0.0.1:45369/ using document root <none> and password file <none>
I20260808 16:00:59.342211 21873 fs_manager.cc:359] Metadata directory not provided
I20260808 16:00:59.342275 21873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:00:59.342473 21873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:00:59.344460 21873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "ef5cebb38a184d14bf4d3d69d9728a9c"
format_stamp: "Formatted at 2026-08-08 16:00:59 on dist-test-slave-lgr5"
server_key: "52c689f3aefebfe9aaf726990a73f453"
server_key_iv: "efb7089fa7fa464e91d7cfe2c5f3495f"
server_key_version: "encryptionkey@0"
I20260808 16:00:59.344982 21873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "ef5cebb38a184d14bf4d3d69d9728a9c"
format_stamp: "Formatted at 2026-08-08 16:00:59 on dist-test-slave-lgr5"
server_key: "52c689f3aefebfe9aaf726990a73f453"
server_key_iv: "efb7089fa7fa464e91d7cfe2c5f3495f"
server_key_version: "encryptionkey@0"
I20260808 16:00:59.348367 21873 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 16:00:59.350530 21901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:00:59.351650 21873 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:00:59.351761 21873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "ef5cebb38a184d14bf4d3d69d9728a9c"
format_stamp: "Formatted at 2026-08-08 16:00:59 on dist-test-slave-lgr5"
server_key: "52c689f3aefebfe9aaf726990a73f453"
server_key_iv: "efb7089fa7fa464e91d7cfe2c5f3495f"
server_key_version: "encryptionkey@0"
I20260808 16:00:59.351846 21873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:00:59.372403 21873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:00:59.374841 21873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:00:59.375013 21873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:00:59.381430 21873 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43317
I20260808 16:00:59.381474 21977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43317 every 8 connection(s)
I20260808 16:00:59.382304 21873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:00:59.384914 21979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:00:59.390106 21979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c: Bootstrap starting.
I20260808 16:00:59.390125 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 21873
I20260808 16:00:59.390235 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:00:59.390509 19828 external_mini_cluster.cc:1428] Setting key 78eca3d984d495c380dd0cb32059de79
I20260808 16:00:59.392616 21979 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c: Neither blocks nor log segments found. Creating new log.
I20260808 16:00:59.393474 21979 log.cc:824] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c: Log is configured to *not* fsync() on all Append() calls
I20260808 16:00:59.395586 21979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c: No bootstrap required, opened a new log
Aug 08 16:00:59 dist-test-slave-lgr5 krb5kdc[21846](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 16:00:59.399371 21979 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef5cebb38a184d14bf4d3d69d9728a9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43317 } }
I20260808 16:00:59.399590 21979 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:00:59.399643 21979 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5cebb38a184d14bf4d3d69d9728a9c, State: Initialized, Role: FOLLOWER
I20260808 16:00:59.400106 21979 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef5cebb38a184d14bf4d3d69d9728a9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43317 } }
I20260808 16:00:59.400270 21979 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:00:59.400341 21979 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:00:59.400444 21979 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:00:59.401233 21979 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef5cebb38a184d14bf4d3d69d9728a9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43317 } }
I20260808 16:00:59.401542 21979 leader_election.cc:302] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef5cebb38a184d14bf4d3d69d9728a9c; no voters:
I20260808 16:00:59.401818 21979 leader_election.cc:288] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:00:59.401890 21994 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:00:59.402096 21994 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [term 1 LEADER]: Becoming Leader. State: Replica: ef5cebb38a184d14bf4d3d69d9728a9c, State: Running, Role: LEADER
I20260808 16:00:59.402427 21994 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef5cebb38a184d14bf4d3d69d9728a9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43317 } }
I20260808 16:00:59.403028 21979 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:00:59.404062 21996 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef5cebb38a184d14bf4d3d69d9728a9c. Latest consensus state: current_term: 1 leader_uuid: "ef5cebb38a184d14bf4d3d69d9728a9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef5cebb38a184d14bf4d3d69d9728a9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43317 } } }
I20260808 16:00:59.404274 21996 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:59.404686 22008 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:00:59.405076 21986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:59.391727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:49735 (local address 127.0.0.1:43317)
0808 16:00:59.392128 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:59.392146 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:59.392187 (+ 41us) server_negotiation.cc:407] Connection header received
0808 16:00:59.392984 (+ 797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:59.393008 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:59.393410 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:59.393766 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:59.394563 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:59.395981 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:59.396857 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:59.397556 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:59.397704 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:59.400102 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:59.400109 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:59.400125 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:59.400156 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:59.401842 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:59.402431 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:59.402438 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:59.402444 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:59.402583 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:59.402923 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:59.402926 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:59.402928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:59.403338 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:59.403559 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:59.403865 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 16:00:59.404124 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":92,"threads_started":1}
I20260808 16:00:59.405246 21995 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef5cebb38a184d14bf4d3d69d9728a9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef5cebb38a184d14bf4d3d69d9728a9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43317 } } }
I20260808 16:00:59.405325 21995 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c [sys.catalog]: This master's current role is: LEADER
I20260808 16:00:59.408027 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:00:59.408249 22008 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:00:59.413435 22008 catalog_manager.cc:1347] Generated new cluster ID: 625f28e9da8c47f0bc94017f5fbefc84
I20260808 16:00:59.413537 22008 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:00:59.419993 21986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:00:59.409898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:37143 (local address 127.0.0.1:43317)
0808 16:00:59.409995 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 16:00:59.409999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:00:59.411726 (+ 1727us) server_negotiation.cc:407] Connection header received
0808 16:00:59.411836 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:00:59.411839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:00:59.411894 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:00:59.411963 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:00:59.412839 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:59.413634 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:59.414696 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:00:59.415054 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:00:59.415164 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:00:59.416741 (+ 1577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:00:59.416745 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:00:59.416748 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:00:59.416775 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:00:59.418317 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:59.418797 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:59.418800 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:59.418802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:59.418894 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:00:59.419182 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:00:59.419185 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:00:59.419187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:00:59.419382 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:00:59.419517 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 16:00:59.419743 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 16:00:59.419834 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 16:00:59.421948 22008 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:00:59.422724 22008 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:00:59.433221 22008 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef5cebb38a184d14bf4d3d69d9728a9c: Generated new TSK 0
I20260808 16:00:59.433812 22008 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:00:59.440721 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 21873
W20260808 16:00:59.451494 21841 connection.cc:535] client connection to 127.0.0.1:43317 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43317): Connection reset by peer (error 104)
2026-08-08T16:00:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1499 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:00:59 dist-test-slave-lgr5 krb5kdc[22030](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:00:59 dist-test-slave-lgr5 krb5kdc[22030](info): set up 2 sockets
Aug 08 16:00:59 dist-test-slave-lgr5 krb5kdc[22030](info): commencing operation
krb5kdc: starting...
W20260808 16:01:00.579404 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:01:00 dist-test-slave-lgr5 krb5kdc[22030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:01:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:01:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 16:01:00.693061 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40845
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:01:00.798444 22049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:01:00.798666 22049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:01:00.798722 22049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:01:00.802635 22049 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:01:00.802690 22049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:01:00.802717 22049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:01:00.802737 22049 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:01:00.802764 22049 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:01:00.807716 22049 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40845
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:01:00.808627 22049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:01:00.809527 22049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:01:00.817325 22064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:00.817305 22057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:00.817322 22054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:00.817590 22049 server_base.cc:1034] running on GCE node
I20260808 16:01:00.818107 22049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:01:00.819096 22049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:01:00.820246 22049 hybrid_clock.cc:648] HybridClock initialized: now 1786204860820239 us; error 42 us; skew 500 ppm
Aug 08 16:01:00 dist-test-slave-lgr5 krb5kdc[22030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204860, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:01:00.825697 22049 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 16:01:00.826514 22049 webserver.cc:460] Webserver started at http://127.0.0.1:39411/ using document root <none> and password file <none>
I20260808 16:01:00.827013 22049 fs_manager.cc:359] Metadata directory not provided
I20260808 16:01:00.827070 22049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:01:00.827261 22049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:01:00.829231 22049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "b7d9c08a71e948b29cbcb8163502a814"
format_stamp: "Formatted at 2026-08-08 16:01:00 on dist-test-slave-lgr5"
server_key: "280c537e7e59058628f9ece41e7ab4e3"
server_key_iv: "8367b7df3f03a1e068c456c557f2aea3"
server_key_version: "encryptionkey@0"
I20260808 16:01:00.829736 22049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "b7d9c08a71e948b29cbcb8163502a814"
format_stamp: "Formatted at 2026-08-08 16:01:00 on dist-test-slave-lgr5"
server_key: "280c537e7e59058628f9ece41e7ab4e3"
server_key_iv: "8367b7df3f03a1e068c456c557f2aea3"
server_key_version: "encryptionkey@0"
I20260808 16:01:00.833174 22049 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 16:01:00.835320 22073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:01:00.836498 22049 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:01:00.836606 22049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "b7d9c08a71e948b29cbcb8163502a814"
format_stamp: "Formatted at 2026-08-08 16:01:00 on dist-test-slave-lgr5"
server_key: "280c537e7e59058628f9ece41e7ab4e3"
server_key_iv: "8367b7df3f03a1e068c456c557f2aea3"
server_key_version: "encryptionkey@0"
I20260808 16:01:00.836696 22049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:01:00.858301 22049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:01:00.860970 22049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:01:00.861124 22049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:01:00.867662 22049 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40845
I20260808 16:01:00.867708 22167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40845 every 8 connection(s)
I20260808 16:01:00.868602 22049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:01:00.871178 22169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:01:00.876434 22169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814: Bootstrap starting.
I20260808 16:01:00.878221 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 22049
I20260808 16:01:00.878367 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:01:00.878655 19828 external_mini_cluster.cc:1428] Setting key 0226795454732fac02d3c6ce34509ec9
I20260808 16:01:00.878933 22169 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814: Neither blocks nor log segments found. Creating new log.
I20260808 16:01:00.879688 22169 log.cc:824] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814: Log is configured to *not* fsync() on all Append() calls
I20260808 16:01:00.881500 22169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814: No bootstrap required, opened a new log
I20260808 16:01:00.884794 22169 raft_consensus.cc:348] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d9c08a71e948b29cbcb8163502a814" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40845 } }
I20260808 16:01:00.885048 22169 raft_consensus.cc:374] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:01:00.885120 22169 raft_consensus.cc:729] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7d9c08a71e948b29cbcb8163502a814, State: Initialized, Role: FOLLOWER
I20260808 16:01:00.885526 22169 consensus_queue.cc:260] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d9c08a71e948b29cbcb8163502a814" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40845 } }
I20260808 16:01:00.885656 22169 raft_consensus.cc:388] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:01:00.885710 22169 raft_consensus.cc:482] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:01:00.885799 22169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:01:00.886664 22169 raft_consensus.cc:504] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d9c08a71e948b29cbcb8163502a814" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40845 } }
I20260808 16:01:00.886837 22176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:00.879761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:41551 (local address 127.0.0.1:40845)
0808 16:01:00.880202 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:00.880221 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:00.880262 (+ 41us) server_negotiation.cc:407] Connection header received
0808 16:01:00.880936 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:00.880953 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:00.881255 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:00.881553 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:00.881958 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:00.882866 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:00.883740 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:00.884233 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:00.884379 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:00.885237 (+ 858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:00.885242 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:00.885254 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:01:00.885648 (+ 394us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:00.885716 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:01:00.885745 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:00.885878 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:00.886042 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 16:01:00.886166 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":119,"threads_started":1}
I20260808 16:01:00.886996 22169 leader_election.cc:302] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7d9c08a71e948b29cbcb8163502a814; no voters:
I20260808 16:01:00.887307 22169 leader_election.cc:288] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:01:00.887380 22179 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:01:00.887622 22179 raft_consensus.cc:686] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [term 1 LEADER]: Becoming Leader. State: Replica: b7d9c08a71e948b29cbcb8163502a814, State: Running, Role: LEADER
I20260808 16:01:00.887956 22179 consensus_queue.cc:237] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d9c08a71e948b29cbcb8163502a814" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40845 } }
I20260808 16:01:00.888487 22169 sys_catalog.cc:564] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:01:00.889014 22181 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b7d9c08a71e948b29cbcb8163502a814. Latest consensus state: current_term: 1 leader_uuid: "b7d9c08a71e948b29cbcb8163502a814" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d9c08a71e948b29cbcb8163502a814" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40845 } } }
I20260808 16:01:00.889142 22181 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:00.889539 22180 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b7d9c08a71e948b29cbcb8163502a814" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d9c08a71e948b29cbcb8163502a814" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40845 } } }
I20260808 16:01:00.889688 22180 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814 [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:00.889842 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:01:00.889544 22188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:01:00.893702 22188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:01:00.896587 22176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:00.891961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:37247 (local address 127.0.0.1:40845)
0808 16:01:00.892054 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:00.892058 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:00.892487 (+ 429us) server_negotiation.cc:407] Connection header received
0808 16:01:00.892606 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:00.892608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:00.892651 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:00.892729 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:00.893010 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:00.893706 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:00.894816 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:00.895143 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:00.895218 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:00.896151 (+ 933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:00.896154 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:00.896157 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:01:00.896170 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:00.896193 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:01:00.896203 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:00.896268 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:00.896430 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 16:01:00.896461 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 16:01:00.899259 22188 catalog_manager.cc:1347] Generated new cluster ID: f9e2e5a7c396472a9fc51875f0846956
I20260808 16:01:00.899317 22188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:01:00.917770 22188 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:01:00.918630 22188 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:01:00.924785 22188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b7d9c08a71e948b29cbcb8163502a814: Generated new TSK 0
I20260808 16:01:00.925377 22188 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:01:00.936323 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 22049
W20260808 16:01:00.954753 22028 connection.cc:535] client connection to 127.0.0.1:40845 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40845): Connection reset by peer (error 104)
2026-08-08T16:01:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1503 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:01:01 dist-test-slave-lgr5 krb5kdc[22220](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:01:01 dist-test-slave-lgr5 krb5kdc[22220](info): set up 2 sockets
Aug 08 16:01:01 dist-test-slave-lgr5 krb5kdc[22220](info): commencing operation
krb5kdc: starting...
W20260808 16:01:02.097949 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:01:02 dist-test-slave-lgr5 krb5kdc[22220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:01:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:01:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 16:01:02.212143 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36563
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36563
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:01:02.318594 22237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:01:02.318837 22237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:01:02.318876 22237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:01:02.323009 22237 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:01:02.323071 22237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:01:02.323091 22237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:01:02.323117 22237 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:01:02.323148 22237 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:01:02.328491 22237 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36563
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22237
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:01:02.329457 22237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:01:02.330412 22237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:01:02.338563 22250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:02.338668 22248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:02.338727 22237 server_base.cc:1034] running on GCE node
W20260808 16:01:02.338559 22252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:02.339437 22237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:01:02.340549 22237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:01:02.341703 22237 hybrid_clock.cc:648] HybridClock initialized: now 1786204862341673 us; error 41 us; skew 500 ppm
Aug 08 16:01:02 dist-test-slave-lgr5 krb5kdc[22220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204862, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:01:02.344405 22237 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 16:01:02.345191 22237 webserver.cc:460] Webserver started at http://127.0.0.1:40819/ using document root <none> and password file <none>
I20260808 16:01:02.345690 22237 fs_manager.cc:359] Metadata directory not provided
I20260808 16:01:02.345748 22237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:01:02.345938 22237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:01:02.348248 22237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "ea76aa8286ef420985efdcab3a98961f"
format_stamp: "Formatted at 2026-08-08 16:01:02 on dist-test-slave-lgr5"
server_key: "051da4646a5c131b4b3f5b4b8715a830"
server_key_iv: "83f247cf3c0389e3d8c35337a74329ed"
server_key_version: "encryptionkey@0"
I20260808 16:01:02.348922 22237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "ea76aa8286ef420985efdcab3a98961f"
format_stamp: "Formatted at 2026-08-08 16:01:02 on dist-test-slave-lgr5"
server_key: "051da4646a5c131b4b3f5b4b8715a830"
server_key_iv: "83f247cf3c0389e3d8c35337a74329ed"
server_key_version: "encryptionkey@0"
I20260808 16:01:02.353340 22237 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 16:01:02.356168 22260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:01:02.357317 22237 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:01:02.357437 22237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "ea76aa8286ef420985efdcab3a98961f"
format_stamp: "Formatted at 2026-08-08 16:01:02 on dist-test-slave-lgr5"
server_key: "051da4646a5c131b4b3f5b4b8715a830"
server_key_iv: "83f247cf3c0389e3d8c35337a74329ed"
server_key_version: "encryptionkey@0"
I20260808 16:01:02.357532 22237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:01:02.361797 22237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:01:02.364665 22237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:01:02.364815 22237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:01:02.371212 22237 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36563
I20260808 16:01:02.371253 22343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36563 every 8 connection(s)
I20260808 16:01:02.372040 22237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:01:02.374977 22345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:01:02.377159 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 22237
I20260808 16:01:02.377281 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:01:02.377578 19828 external_mini_cluster.cc:1428] Setting key 2f378e4e4076393161157161ad3f821a
I20260808 16:01:02.380890 22345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f: Bootstrap starting.
I20260808 16:01:02.382872 22350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:02.378886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:56479 (local address 127.0.0.1:36563)
0808 16:01:02.379308 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:02.379325 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:02.379366 (+ 41us) server_negotiation.cc:407] Connection header received
0808 16:01:02.380171 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:02.380195 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:02.380517 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:02.380864 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:02.381499 (+ 635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:02.381504 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:02.381517 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:01:02.381529 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:02.381595 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:01:02.381620 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:02.381745 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:02.381879 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 16:01:02.382033 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":124,"threads_started":1}
I20260808 16:01:02.383471 22345 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f: Neither blocks nor log segments found. Creating new log.
I20260808 16:01:02.384268 22345 log.cc:824] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f: Log is configured to *not* fsync() on all Append() calls
I20260808 16:01:02.385601 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:01:02.386264 22345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f: No bootstrap required, opened a new log
I20260808 16:01:02.389189 22350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:02.387786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:46519 (local address 127.0.0.1:36563)
0808 16:01:02.387978 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:02.387981 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:02.387995 (+ 14us) server_negotiation.cc:407] Connection header received
0808 16:01:02.388128 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:02.388131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:02.388162 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:02.388221 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:02.388841 (+ 620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:02.388844 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:02.388847 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:01:02.388860 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:02.388883 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:01:02.388893 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:02.388970 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:02.389048 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 16:01:02.389085 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 16:01:02.390090 22345 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea76aa8286ef420985efdcab3a98961f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36563 } }
I20260808 16:01:02.390290 22345 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:01:02.390336 22345 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea76aa8286ef420985efdcab3a98961f, State: Initialized, Role: FOLLOWER
I20260808 16:01:02.390686 22345 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea76aa8286ef420985efdcab3a98961f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36563 } }
I20260808 16:01:02.390803 22345 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:01:02.390847 22345 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:01:02.390913 22345 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:01:02.391651 22345 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea76aa8286ef420985efdcab3a98961f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36563 } }
I20260808 16:01:02.391924 22345 leader_election.cc:302] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea76aa8286ef420985efdcab3a98961f; no voters:
I20260808 16:01:02.392184 22345 leader_election.cc:288] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:01:02.392274 22362 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:01:02.392490 22362 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [term 1 LEADER]: Becoming Leader. State: Replica: ea76aa8286ef420985efdcab3a98961f, State: Running, Role: LEADER
I20260808 16:01:02.392791 22362 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea76aa8286ef420985efdcab3a98961f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36563 } }
I20260808 16:01:02.393250 22345 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:01:02.394300 22363 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea76aa8286ef420985efdcab3a98961f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea76aa8286ef420985efdcab3a98961f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36563 } } }
I20260808 16:01:02.394418 22363 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:02.394801 22367 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea76aa8286ef420985efdcab3a98961f. Latest consensus state: current_term: 1 leader_uuid: "ea76aa8286ef420985efdcab3a98961f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea76aa8286ef420985efdcab3a98961f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36563 } } }
I20260808 16:01:02.395547 22367 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f [sys.catalog]: This master's current role is: LEADER
W20260808 16:01:02.397655 22388 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 16:01:02.397717 22388 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 16:01:02.397804 22380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:01:02.398492 22380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:01:02.402969 22380 catalog_manager.cc:1347] Generated new cluster ID: 8ccbf14863534db793eef260ce7431d1
I20260808 16:01:02.403028 22380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:01:02.419615 22380 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:01:02.419906 22380 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:01:02.430626 22380 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea76aa8286ef420985efdcab3a98961f: Generated new TSK 0
I20260808 16:01:02.431182 22380 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:01:02.439972 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 22237
2026-08-08T16:01:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1495 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:01:02 dist-test-slave-lgr5 krb5kdc[22397](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:01:02 dist-test-slave-lgr5 krb5kdc[22397](info): set up 2 sockets
Aug 08 16:01:02 dist-test-slave-lgr5 krb5kdc[22397](info): commencing operation
krb5kdc: starting...
W20260808 16:01:03.581233 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:01:03 dist-test-slave-lgr5 krb5kdc[22397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:01:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:01:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 16:01:03.694548 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:34405
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:39311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:34405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:01:03.801565 22431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:01:03.801788 22431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:01:03.801826 22431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:01:03.805706 22431 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:01:03.805757 22431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:01:03.805775 22431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:01:03.805795 22431 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:01:03.805812 22431 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:01:03.810746 22431 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:39311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:34405
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:34405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:01:03.811609 22431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:01:03.812553 22431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:01:03.820345 22442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:03.820338 22441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:03.820466 22431 server_base.cc:1034] running on GCE node
W20260808 16:01:03.820339 22446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:03.821100 22431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:01:03.822094 22431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:01:03.823266 22431 hybrid_clock.cc:648] HybridClock initialized: now 1786204863823252 us; error 28 us; skew 500 ppm
Aug 08 16:01:03 dist-test-slave-lgr5 krb5kdc[22397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204863, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:01:03.825876 22431 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 16:01:03.826707 22431 webserver.cc:460] Webserver started at http://127.19.93.62:40911/ using document root <none> and password file <none>
I20260808 16:01:03.827215 22431 fs_manager.cc:359] Metadata directory not provided
I20260808 16:01:03.827281 22431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:01:03.827502 22431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:01:03.829471 22431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "28fc2e67d1d54fa490d91af70ec49b23"
format_stamp: "Formatted at 2026-08-08 16:01:03 on dist-test-slave-lgr5"
server_key: "b2521bff90983db1488b8398874e0ff9"
server_key_iv: "919ae55d65363e2512f81e51b6082c10"
server_key_version: "encryptionkey@0"
I20260808 16:01:03.830009 22431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "28fc2e67d1d54fa490d91af70ec49b23"
format_stamp: "Formatted at 2026-08-08 16:01:03 on dist-test-slave-lgr5"
server_key: "b2521bff90983db1488b8398874e0ff9"
server_key_iv: "919ae55d65363e2512f81e51b6082c10"
server_key_version: "encryptionkey@0"
I20260808 16:01:03.833559 22431 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 16:01:03.835939 22454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:01:03.837146 22431 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:01:03.837261 22431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "28fc2e67d1d54fa490d91af70ec49b23"
format_stamp: "Formatted at 2026-08-08 16:01:03 on dist-test-slave-lgr5"
server_key: "b2521bff90983db1488b8398874e0ff9"
server_key_iv: "919ae55d65363e2512f81e51b6082c10"
server_key_version: "encryptionkey@0"
I20260808 16:01:03.837352 22431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:01:03.865298 22431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:01:03.867839 22431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:01:03.868000 22431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:01:03.874503 22431 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:34405
I20260808 16:01:03.874519 22535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:34405 every 8 connection(s)
I20260808 16:01:03.875427 22431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:01:03.878033 22536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:01:03.879699 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 22431
I20260808 16:01:03.879833 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:01:03.880116 19828 external_mini_cluster.cc:1428] Setting key 987831d5bab2179b62a1a9b2ad6425d3
I20260808 16:01:03.884060 22536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23: Bootstrap starting.
I20260808 16:01:03.886471 22536 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23: Neither blocks nor log segments found. Creating new log.
I20260808 16:01:03.887307 22536 log.cc:824] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23: Log is configured to *not* fsync() on all Append() calls
Aug 08 16:01:03 dist-test-slave-lgr5 krb5kdc[22397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:01:03.889165 22536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23: No bootstrap required, opened a new log
I20260808 16:01:03.892508 22536 raft_consensus.cc:348] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28fc2e67d1d54fa490d91af70ec49b23" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34405 } }
I20260808 16:01:03.892764 22536 raft_consensus.cc:374] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:01:03.892827 22536 raft_consensus.cc:729] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28fc2e67d1d54fa490d91af70ec49b23, State: Initialized, Role: FOLLOWER
I20260808 16:01:03.893227 22536 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28fc2e67d1d54fa490d91af70ec49b23" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34405 } }
I20260808 16:01:03.893357 22536 raft_consensus.cc:388] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:01:03.893415 22540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:03.881325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53105 (local address 127.19.93.62:34405)
0808 16:01:03.881687 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:03.881701 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:03.881736 (+ 35us) server_negotiation.cc:407] Connection header received
0808 16:01:03.882349 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:03.882365 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:03.882682 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:03.882934 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:03.883801 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:03.884791 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:03.885949 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:03.886394 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:03.886500 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:03.889081 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:03.889086 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:03.889097 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:03.889123 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:03.890631 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:03.891132 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:03.891137 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:03.891141 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:03.891247 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:03.891570 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:03.891572 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:03.891573 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:03.891924 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:03.892157 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:03.892477 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 16:01:03.892676 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":96,"threads_started":1}
I20260808 16:01:03.893429 22536 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:01:03.893565 22536 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:01:03.894363 22536 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28fc2e67d1d54fa490d91af70ec49b23" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34405 } }
I20260808 16:01:03.894711 22536 leader_election.cc:302] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28fc2e67d1d54fa490d91af70ec49b23; no voters:
I20260808 16:01:03.895030 22536 leader_election.cc:288] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:01:03.895130 22542 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:01:03.895320 22542 raft_consensus.cc:686] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [term 1 LEADER]: Becoming Leader. State: Replica: 28fc2e67d1d54fa490d91af70ec49b23, State: Running, Role: LEADER
I20260808 16:01:03.895620 22542 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28fc2e67d1d54fa490d91af70ec49b23" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34405 } }
I20260808 16:01:03.896255 22536 sys_catalog.cc:564] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:01:03.896514 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:01:03.898842 22544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "28fc2e67d1d54fa490d91af70ec49b23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28fc2e67d1d54fa490d91af70ec49b23" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34405 } } }
I20260808 16:01:03.898969 22544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:03.899189 22547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 28fc2e67d1d54fa490d91af70ec49b23. Latest consensus state: current_term: 1 leader_uuid: "28fc2e67d1d54fa490d91af70ec49b23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28fc2e67d1d54fa490d91af70ec49b23" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 34405 } } }
I20260808 16:01:03.899552 22547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23 [sys.catalog]: This master's current role is: LEADER
W20260808 16:01:03.901854 22576 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 16:01:03.901947 22576 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 16:01:03.902066 22577 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:01:03.903695 22577 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:01:03.906359 22540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:03.898907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41747 (local address 127.19.93.62:34405)
0808 16:01:03.898999 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:03.899002 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:03.899012 (+ 10us) server_negotiation.cc:407] Connection header received
0808 16:01:03.899041 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:03.899044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:03.899082 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:03.899142 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:03.900014 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:03.900541 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:03.901313 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:03.901535 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:03.901620 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:03.902832 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:03.902836 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:03.902839 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:03.902864 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:03.904450 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:03.905008 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:03.905012 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:03.905013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:03.905095 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:03.905482 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:03.905485 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:03.905487 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:03.905688 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:03.905832 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:03.906113 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 16:01:03.906209 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 16:01:03.909137 22577 catalog_manager.cc:1347] Generated new cluster ID: 86550484c08e4f96864f54a39280dac3
I20260808 16:01:03.909189 22577 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:01:03.941866 22577 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:01:03.942775 22577 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:01:03.948726 22577 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 28fc2e67d1d54fa490d91af70ec49b23: Generated new TSK 0
I20260808 16:01:03.949337 22577 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:01:03.953188 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 22431
W20260808 16:01:03.966872 22392 connection.cc:535] client connection to 127.19.93.62:34405 recv error: Network error: failed to read from TLS socket (remote: 127.19.93.62:34405): Connection reset by peer (error 104)
2026-08-08T16:01:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1516 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:01:04 dist-test-slave-lgr5 krb5kdc[22589](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:01:04 dist-test-slave-lgr5 krb5kdc[22589](info): set up 2 sockets
Aug 08 16:01:04 dist-test-slave-lgr5 krb5kdc[22589](info): commencing operation
krb5kdc: starting...
W20260808 16:01:05.093072 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:01:05 dist-test-slave-lgr5 krb5kdc[22589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:01:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:01:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 16:01:05.206459 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:44239
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:44931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:44239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:01:05.311136 22612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:01:05.311367 22612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:01:05.311405 22612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:01:05.315256 22612 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:01:05.315310 22612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:01:05.315327 22612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:01:05.315342 22612 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:01:05.315361 22612 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:01:05.320348 22612 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:44931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:44239
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:44239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:01:05.321283 22612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:01:05.322196 22612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:01:05.330339 22624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:05.330331 22622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:05.330333 22621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:05.330396 22612 server_base.cc:1034] running on GCE node
I20260808 16:01:05.331108 22612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:01:05.332156 22612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:01:05.333338 22612 hybrid_clock.cc:648] HybridClock initialized: now 1786204865333313 us; error 35 us; skew 500 ppm
Aug 08 16:01:05 dist-test-slave-lgr5 krb5kdc[22589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204865, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:01:05.335979 22612 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 16:01:05.336817 22612 webserver.cc:460] Webserver started at http://127.19.93.62:34141/ using document root <none> and password file <none>
I20260808 16:01:05.337313 22612 fs_manager.cc:359] Metadata directory not provided
I20260808 16:01:05.337369 22612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:01:05.337538 22612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:01:05.339632 22612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "6e140ce0c5df439ab26b5feb33286dc6"
format_stamp: "Formatted at 2026-08-08 16:01:05 on dist-test-slave-lgr5"
server_key: "42ba2db567de7aee0738aaa96b06b38a"
server_key_iv: "cb74271010d185b880b88ca04e75e8ab"
server_key_version: "encryptionkey@0"
I20260808 16:01:05.340235 22612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "6e140ce0c5df439ab26b5feb33286dc6"
format_stamp: "Formatted at 2026-08-08 16:01:05 on dist-test-slave-lgr5"
server_key: "42ba2db567de7aee0738aaa96b06b38a"
server_key_iv: "cb74271010d185b880b88ca04e75e8ab"
server_key_version: "encryptionkey@0"
I20260808 16:01:05.343770 22612 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 16:01:05.346024 22635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:01:05.347143 22612 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:01:05.347250 22612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "6e140ce0c5df439ab26b5feb33286dc6"
format_stamp: "Formatted at 2026-08-08 16:01:05 on dist-test-slave-lgr5"
server_key: "42ba2db567de7aee0738aaa96b06b38a"
server_key_iv: "cb74271010d185b880b88ca04e75e8ab"
server_key_version: "encryptionkey@0"
I20260808 16:01:05.347345 22612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:01:05.361092 22612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:01:05.364245 22612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:01:05.364442 22612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:01:05.370915 22612 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:44239
I20260808 16:01:05.370983 22713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:44239 every 8 connection(s)
I20260808 16:01:05.371842 22612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:01:05.374523 22714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:01:05.379808 22714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6: Bootstrap starting.
I20260808 16:01:05.381242 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 22612
I20260808 16:01:05.381366 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:01:05.381618 19828 external_mini_cluster.cc:1428] Setting key 6890079f4df450c42d128083412c99a0
I20260808 16:01:05.382354 22714 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6: Neither blocks nor log segments found. Creating new log.
I20260808 16:01:05.383191 22714 log.cc:824] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6: Log is configured to *not* fsync() on all Append() calls
I20260808 16:01:05.385314 22714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6: No bootstrap required, opened a new log
I20260808 16:01:05.389231 22714 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e140ce0c5df439ab26b5feb33286dc6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44239 } }
I20260808 16:01:05.389492 22714 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:01:05.389561 22714 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e140ce0c5df439ab26b5feb33286dc6, State: Initialized, Role: FOLLOWER
I20260808 16:01:05.390030 22714 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e140ce0c5df439ab26b5feb33286dc6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44239 } }
I20260808 16:01:05.390184 22714 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:01:05.390245 22714 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:01:05.390340 22714 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:01:05.390951 22722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:05.382634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39843 (local address 127.19.93.62:44239)
0808 16:01:05.383072 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:05.383091 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:05.383133 (+ 42us) server_negotiation.cc:407] Connection header received
0808 16:01:05.383883 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:05.383909 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:05.384340 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:05.384692 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:05.385094 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:05.386525 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:05.387390 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:05.388132 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:05.388283 (+ 151us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:05.389033 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:05.389038 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:05.389053 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:01:05.389518 (+ 465us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:05.389584 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:01:05.389617 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:05.389745 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:05.389892 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 16:01:05.390015 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":119,"threads_started":1}
I20260808 16:01:05.391350 22714 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e140ce0c5df439ab26b5feb33286dc6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44239 } }
I20260808 16:01:05.391655 22714 leader_election.cc:302] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e140ce0c5df439ab26b5feb33286dc6; no voters:
I20260808 16:01:05.391968 22714 leader_election.cc:288] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:01:05.392025 22725 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:01:05.392267 22725 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [term 1 LEADER]: Becoming Leader. State: Replica: 6e140ce0c5df439ab26b5feb33286dc6, State: Running, Role: LEADER
I20260808 16:01:05.392602 22725 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e140ce0c5df439ab26b5feb33286dc6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44239 } }
I20260808 16:01:05.393134 22714 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:01:05.394934 22731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e140ce0c5df439ab26b5feb33286dc6. Latest consensus state: current_term: 1 leader_uuid: "6e140ce0c5df439ab26b5feb33286dc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e140ce0c5df439ab26b5feb33286dc6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44239 } } }
I20260808 16:01:05.395032 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:01:05.395072 22731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:05.396224 22728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e140ce0c5df439ab26b5feb33286dc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e140ce0c5df439ab26b5feb33286dc6" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44239 } } }
I20260808 16:01:05.396380 22728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6 [sys.catalog]: This master's current role is: LEADER
W20260808 16:01:05.397701 22751 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 16:01:05.397765 22751 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 16:01:05.397831 22752 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:01:05.398761 22752 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:01:05.402201 22722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:05.398197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43005 (local address 127.19.93.62:44239)
0808 16:01:05.398299 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:05.398302 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:05.398438 (+ 136us) server_negotiation.cc:407] Connection header received
0808 16:01:05.398549 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:05.398552 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:05.398593 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:05.398669 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:05.398944 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:05.399679 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:05.400705 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:05.400932 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:05.401017 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:05.401777 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:05.401781 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:05.401783 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:01:05.401795 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:05.401820 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:01:05.401830 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:05.401899 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:05.402045 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 16:01:05.402076 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 16:01:05.404052 22752 catalog_manager.cc:1347] Generated new cluster ID: 06e6df1864e343b7bd501d593e6c8af1
I20260808 16:01:05.404131 22752 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:01:05.416711 22752 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:01:05.417531 22752 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:01:05.425573 22752 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e140ce0c5df439ab26b5feb33286dc6: Generated new TSK 0
I20260808 16:01:05.426133 22752 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:01:05.435950 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 22612
W20260808 16:01:05.453644 22586 connection.cc:535] client connection to 127.19.93.62:44239 recv error: Network error: failed to read from TLS socket (remote: 127.19.93.62:44239): Connection reset by peer (error 104)
2026-08-08T16:01:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1486 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:01:05 dist-test-slave-lgr5 krb5kdc[22771](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:01:05 dist-test-slave-lgr5 krb5kdc[22771](info): set up 2 sockets
Aug 08 16:01:05 dist-test-slave-lgr5 krb5kdc[22771](info): commencing operation
krb5kdc: starting...
W20260808 16:01:06.598126 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:01:06 dist-test-slave-lgr5 krb5kdc[22771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:01:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:01:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 16:01:06.723255 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:46787
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:39133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:46787
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:01:06.828186 22792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:01:06.828423 22792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:01:06.828478 22792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:01:06.832398 22792 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:01:06.832448 22792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:01:06.832473 22792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:01:06.832495 22792 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:01:06.832523 22792 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:01:06.837482 22792 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:39133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:46787
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:46787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:01:06.838397 22792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:01:06.839293 22792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 16:01:06.847137 22792 server_base.cc:1034] running on GCE node
W20260808 16:01:06.847088 22799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:06.847084 22798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:06.847085 22802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:06.847887 22792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:01:06.848886 22792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:01:06.850041 22792 hybrid_clock.cc:648] HybridClock initialized: now 1786204866850030 us; error 23 us; skew 500 ppm
Aug 08 16:01:06 dist-test-slave-lgr5 krb5kdc[22771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204866, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:01:06.852573 22792 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 16:01:06.853369 22792 webserver.cc:460] Webserver started at http://127.19.93.62:44277/ using document root <none> and password file <none>
I20260808 16:01:06.853853 22792 fs_manager.cc:359] Metadata directory not provided
I20260808 16:01:06.853916 22792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:01:06.854108 22792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:01:06.855962 22792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "23d4700c8ecd431088c5a9faaeb51e69"
format_stamp: "Formatted at 2026-08-08 16:01:06 on dist-test-slave-lgr5"
server_key: "ecc5e35ede42b22f2f4d9f84c80893f1"
server_key_iv: "7ae011b24dd0cc415a8612abbf8315d4"
server_key_version: "encryptionkey@0"
I20260808 16:01:06.856511 22792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "23d4700c8ecd431088c5a9faaeb51e69"
format_stamp: "Formatted at 2026-08-08 16:01:06 on dist-test-slave-lgr5"
server_key: "ecc5e35ede42b22f2f4d9f84c80893f1"
server_key_iv: "7ae011b24dd0cc415a8612abbf8315d4"
server_key_version: "encryptionkey@0"
I20260808 16:01:06.859761 22792 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 16:01:06.861943 22824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:01:06.863032 22792 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:01:06.863142 22792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "23d4700c8ecd431088c5a9faaeb51e69"
format_stamp: "Formatted at 2026-08-08 16:01:06 on dist-test-slave-lgr5"
server_key: "ecc5e35ede42b22f2f4d9f84c80893f1"
server_key_iv: "7ae011b24dd0cc415a8612abbf8315d4"
server_key_version: "encryptionkey@0"
I20260808 16:01:06.863224 22792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:01:06.867482 22792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:01:06.870334 22792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:01:06.870491 22792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:01:06.876802 22792 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:46787
I20260808 16:01:06.876819 22907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:46787 every 8 connection(s)
I20260808 16:01:06.877594 22792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:01:06.877899 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 22792
I20260808 16:01:06.878041 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:01:06.878350 19828 external_mini_cluster.cc:1428] Setting key c6efc974f46898050567b5aee222b9db
I20260808 16:01:06.880589 22909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:01:06.882933 22912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:06.879558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42533 (local address 127.19.93.62:46787)
0808 16:01:06.879922 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:06.879937 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:06.879970 (+ 33us) server_negotiation.cc:407] Connection header received
0808 16:01:06.880583 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:06.880598 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:06.880885 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:06.881137 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:06.881866 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:06.881871 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:06.881881 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:01:06.881891 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:06.881938 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:01:06.881956 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:06.882057 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:06.882162 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 16:01:06.882285 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":98,"threads_started":1}
I20260808 16:01:06.885651 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:01:06.886547 22909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69: Bootstrap starting.
I20260808 16:01:06.889001 22909 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69: Neither blocks nor log segments found. Creating new log.
I20260808 16:01:06.889221 22912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:06.887785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44907 (local address 127.19.93.62:46787)
0808 16:01:06.887900 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:06.887904 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:06.888073 (+ 169us) server_negotiation.cc:407] Connection header received
0808 16:01:06.888205 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:06.888208 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:06.888239 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:06.888304 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:06.888882 (+ 578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:06.888885 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:06.888888 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:01:06.888900 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:06.888926 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:01:06.888939 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:06.889027 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:06.889083 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 16:01:06.889119 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 16:01:06.889810 22909 log.cc:824] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69: Log is configured to *not* fsync() on all Append() calls
I20260808 16:01:06.891498 22909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69: No bootstrap required, opened a new log
I20260808 16:01:06.894743 22909 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23d4700c8ecd431088c5a9faaeb51e69" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46787 } }
I20260808 16:01:06.894964 22909 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:01:06.895020 22909 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23d4700c8ecd431088c5a9faaeb51e69, State: Initialized, Role: FOLLOWER
I20260808 16:01:06.895406 22909 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23d4700c8ecd431088c5a9faaeb51e69" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46787 } }
I20260808 16:01:06.895521 22909 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:01:06.895582 22909 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:01:06.895673 22909 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:01:06.896473 22909 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23d4700c8ecd431088c5a9faaeb51e69" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46787 } }
I20260808 16:01:06.896780 22909 leader_election.cc:302] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23d4700c8ecd431088c5a9faaeb51e69; no voters:
I20260808 16:01:06.897044 22909 leader_election.cc:288] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:01:06.897136 22921 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:01:06.897333 22921 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [term 1 LEADER]: Becoming Leader. State: Replica: 23d4700c8ecd431088c5a9faaeb51e69, State: Running, Role: LEADER
I20260808 16:01:06.897642 22921 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23d4700c8ecd431088c5a9faaeb51e69" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46787 } }
I20260808 16:01:06.898069 22909 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:01:06.899091 22922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23d4700c8ecd431088c5a9faaeb51e69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23d4700c8ecd431088c5a9faaeb51e69" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46787 } } }
I20260808 16:01:06.899220 22922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:06.899403 22923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23d4700c8ecd431088c5a9faaeb51e69. Latest consensus state: current_term: 1 leader_uuid: "23d4700c8ecd431088c5a9faaeb51e69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23d4700c8ecd431088c5a9faaeb51e69" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 46787 } } }
I20260808 16:01:06.899559 22923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69 [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:06.900261 22938 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:01:06.903081 22938 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:01:06.907930 22938 catalog_manager.cc:1347] Generated new cluster ID: 29367349d9884288bbd4be98f6be08f7
I20260808 16:01:06.907996 22938 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:01:06.928098 22938 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:01:06.928404 22938 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:01:06.945310 22938 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23d4700c8ecd431088c5a9faaeb51e69: Generated new TSK 0
I20260808 16:01:06.945905 22938 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:01:06.957811 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 22792
2026-08-08T16:01:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1515 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:01:07 dist-test-slave-lgr5 krb5kdc[22965](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:01:07 dist-test-slave-lgr5 krb5kdc[22965](info): set up 2 sockets
Aug 08 16:01:07 dist-test-slave-lgr5 krb5kdc[22965](info): commencing operation
krb5kdc: starting...
W20260808 16:01:08.109019 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:01:08 dist-test-slave-lgr5 krb5kdc[22965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:01:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:01:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 16:01:08.224849 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:35097
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:35789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:35097
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:01:08.332454 22998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:01:08.332691 22998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:01:08.332746 22998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:01:08.336767 22998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:01:08.336826 22998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:01:08.336854 22998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:01:08.336884 22998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:01:08.336912 22998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:01:08.341938 22998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:35789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:35097
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:35097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:01:08.342939 22998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:01:08.343892 22998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:01:08.351819 23007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:08.351979 22998 server_base.cc:1034] running on GCE node
W20260808 16:01:08.351838 23013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:08.351828 23008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:08.352622 22998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:01:08.353633 22998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:01:08.354787 22998 hybrid_clock.cc:648] HybridClock initialized: now 1786204868354769 us; error 30 us; skew 500 ppm
Aug 08 16:01:08 dist-test-slave-lgr5 krb5kdc[22965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204868, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:01:08.357501 22998 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 16:01:08.358412 22998 webserver.cc:460] Webserver started at http://127.19.93.62:43683/ using document root <none> and password file <none>
I20260808 16:01:08.358979 22998 fs_manager.cc:359] Metadata directory not provided
I20260808 16:01:08.359047 22998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:01:08.359241 22998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:01:08.361297 22998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "6fedb1b3bf864c37bbd19187d5179f13"
format_stamp: "Formatted at 2026-08-08 16:01:08 on dist-test-slave-lgr5"
server_key: "698f759f5db78a9640c5d28378f5d31e"
server_key_iv: "beabe53a980d1bb3c0b6a1fcd4a2b0e8"
server_key_version: "encryptionkey@0"
I20260808 16:01:08.361842 22998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "6fedb1b3bf864c37bbd19187d5179f13"
format_stamp: "Formatted at 2026-08-08 16:01:08 on dist-test-slave-lgr5"
server_key: "698f759f5db78a9640c5d28378f5d31e"
server_key_iv: "beabe53a980d1bb3c0b6a1fcd4a2b0e8"
server_key_version: "encryptionkey@0"
I20260808 16:01:08.365463 22998 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 16:01:08.367662 23025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:01:08.368824 22998 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:01:08.368930 22998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "6fedb1b3bf864c37bbd19187d5179f13"
format_stamp: "Formatted at 2026-08-08 16:01:08 on dist-test-slave-lgr5"
server_key: "698f759f5db78a9640c5d28378f5d31e"
server_key_iv: "beabe53a980d1bb3c0b6a1fcd4a2b0e8"
server_key_version: "encryptionkey@0"
I20260808 16:01:08.369022 22998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:01:08.386739 22998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:01:08.389683 22998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:01:08.389869 22998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:01:08.396375 22998 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:35097
I20260808 16:01:08.396406 23110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:35097 every 8 connection(s)
I20260808 16:01:08.397266 22998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:01:08.399832 23111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:01:08.400032 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 22998
I20260808 16:01:08.400177 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:01:08.400449 19828 external_mini_cluster.cc:1428] Setting key 43a55fb5779da0bc6aeff8a952dff934
I20260808 16:01:08.406226 23111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13: Bootstrap starting.
I20260808 16:01:08.408728 23111 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13: Neither blocks nor log segments found. Creating new log.
Aug 08 16:01:08 dist-test-slave-lgr5 krb5kdc[22965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:01:08.409422 23111 log.cc:824] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13: Log is configured to *not* fsync() on all Append() calls
I20260808 16:01:08.411165 23111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13: No bootstrap required, opened a new log
I20260808 16:01:08.413699 23122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:08.401698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48391 (local address 127.19.93.62:35097)
0808 16:01:08.402084 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:08.402102 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:08.402136 (+ 34us) server_negotiation.cc:407] Connection header received
0808 16:01:08.402809 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:08.402826 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:08.403132 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:08.403386 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:08.404310 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:08.405283 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:08.406456 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:08.406905 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:08.407016 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:08.409587 (+ 2571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:08.409592 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:08.409604 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:08.409630 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:08.411146 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:08.411564 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:08.411570 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:08.411574 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:08.411680 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:08.411937 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:08.411941 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:08.411942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:08.412352 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:08.412525 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:08.412788 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 16:01:08.413050 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":116,"threads_started":1}
I20260808 16:01:08.414669 23111 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fedb1b3bf864c37bbd19187d5179f13" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35097 } }
I20260808 16:01:08.414896 23111 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:01:08.414952 23111 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fedb1b3bf864c37bbd19187d5179f13, State: Initialized, Role: FOLLOWER
I20260808 16:01:08.415364 23111 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fedb1b3bf864c37bbd19187d5179f13" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35097 } }
I20260808 16:01:08.415518 23111 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:01:08.415620 23111 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:01:08.415714 23111 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:01:08.416450 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:01:08.416678 23111 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fedb1b3bf864c37bbd19187d5179f13" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35097 } }
I20260808 16:01:08.416983 23111 leader_election.cc:302] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6fedb1b3bf864c37bbd19187d5179f13; no voters:
I20260808 16:01:08.417243 23111 leader_election.cc:288] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:01:08.417349 23125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:01:08.417567 23125 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [term 1 LEADER]: Becoming Leader. State: Replica: 6fedb1b3bf864c37bbd19187d5179f13, State: Running, Role: LEADER
I20260808 16:01:08.417928 23125 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fedb1b3bf864c37bbd19187d5179f13" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35097 } }
I20260808 16:01:08.418344 23111 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:01:08.418955 23125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6fedb1b3bf864c37bbd19187d5179f13. Latest consensus state: current_term: 1 leader_uuid: "6fedb1b3bf864c37bbd19187d5179f13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fedb1b3bf864c37bbd19187d5179f13" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35097 } } }
I20260808 16:01:08.419071 23125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:08.419435 23145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:01:08.419459 23131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6fedb1b3bf864c37bbd19187d5179f13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fedb1b3bf864c37bbd19187d5179f13" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35097 } } }
I20260808 16:01:08.419617 23131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13 [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:08.422392 23145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:01:08.428072 23145 catalog_manager.cc:1347] Generated new cluster ID: c0f4f39d76af40a486aadac3bd204f13
I20260808 16:01:08.428165 23145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:01:08.428753 23122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:08.420537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47313 (local address 127.19.93.62:35097)
0808 16:01:08.420622 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:08.420626 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:08.421036 (+ 410us) server_negotiation.cc:407] Connection header received
0808 16:01:08.421145 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:08.421147 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:08.421191 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:08.421263 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:08.422010 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:08.422682 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:08.423768 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:08.424135 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:08.424234 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:08.425467 (+ 1233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:08.425470 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:08.425473 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:08.425498 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:08.426900 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:08.427358 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:08.427361 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:08.427363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:08.427447 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:08.427760 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:08.427763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:08.427765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:08.427958 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:08.428071 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:08.428409 (+ 338us) server_negotiation.cc:299] Negotiation successful
0808 16:01:08.428512 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 16:01:08.452394 23145 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:01:08.453240 23145 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:01:08.466511 23145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6fedb1b3bf864c37bbd19187d5179f13: Generated new TSK 0
I20260808 16:01:08.467120 23145 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:01:08.475883 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 22998
2026-08-08T16:01:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1516 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:01:08 dist-test-slave-lgr5 krb5kdc[23171](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:01:08 dist-test-slave-lgr5 krb5kdc[23171](info): set up 2 sockets
Aug 08 16:01:08 dist-test-slave-lgr5 krb5kdc[23171](info): commencing operation
krb5kdc: starting...
W20260808 16:01:09.619393 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:01:09 dist-test-slave-lgr5 krb5kdc[23171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:01:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:01:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 16:01:09.735170 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:41393
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:39105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:41393
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:01:09.842146 23204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:01:09.842377 23204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:01:09.842415 23204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:01:09.846247 23204 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:01:09.846295 23204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:01:09.846313 23204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:01:09.846333 23204 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:01:09.846347 23204 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:01:09.851317 23204 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:39105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:41393
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:41393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:01:09.852236 23204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:01:09.853142 23204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:01:09.860842 23212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:09.860917 23215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:09.861086 23204 server_base.cc:1034] running on GCE node
W20260808 16:01:09.860841 23213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:09.861667 23204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:01:09.862623 23204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:01:09.863775 23204 hybrid_clock.cc:648] HybridClock initialized: now 1786204869863762 us; error 24 us; skew 500 ppm
Aug 08 16:01:09 dist-test-slave-lgr5 krb5kdc[23171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204869, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:01:09.866273 23204 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 16:01:09.867095 23204 webserver.cc:460] Webserver started at http://127.19.93.62:43385/ using document root <none> and password file <none>
I20260808 16:01:09.867612 23204 fs_manager.cc:359] Metadata directory not provided
I20260808 16:01:09.867673 23204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:01:09.867872 23204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:01:09.869882 23204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "bdb6217931af4dd385497634742dbcd4"
format_stamp: "Formatted at 2026-08-08 16:01:09 on dist-test-slave-lgr5"
server_key: "6ed8dd3430045231722cb5bd4be43149"
server_key_iv: "b2c870c2d9cbca984e69221cdea1e94f"
server_key_version: "encryptionkey@0"
I20260808 16:01:09.870421 23204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "bdb6217931af4dd385497634742dbcd4"
format_stamp: "Formatted at 2026-08-08 16:01:09 on dist-test-slave-lgr5"
server_key: "6ed8dd3430045231722cb5bd4be43149"
server_key_iv: "b2c870c2d9cbca984e69221cdea1e94f"
server_key_version: "encryptionkey@0"
I20260808 16:01:09.874002 23204 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 16:01:09.876209 23223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:01:09.877334 23204 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 16:01:09.877446 23204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "bdb6217931af4dd385497634742dbcd4"
format_stamp: "Formatted at 2026-08-08 16:01:09 on dist-test-slave-lgr5"
server_key: "6ed8dd3430045231722cb5bd4be43149"
server_key_iv: "b2c870c2d9cbca984e69221cdea1e94f"
server_key_version: "encryptionkey@0"
I20260808 16:01:09.877534 23204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:01:09.902130 23204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:01:09.904706 23204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:01:09.904866 23204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:01:09.911410 23204 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:41393
I20260808 16:01:09.911437 23319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:41393 every 8 connection(s)
I20260808 16:01:09.912297 23204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:01:09.914901 23320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:01:09.920238 23320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4: Bootstrap starting.
I20260808 16:01:09.920903 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 23204
I20260808 16:01:09.921056 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:01:09.921360 19828 external_mini_cluster.cc:1428] Setting key 44f2f71e1a2e781b58069f9761ce1b63
I20260808 16:01:09.922958 23320 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4: Neither blocks nor log segments found. Creating new log.
I20260808 16:01:09.923640 23320 log.cc:824] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4: Log is configured to *not* fsync() on all Append() calls
I20260808 16:01:09.925505 23320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4: No bootstrap required, opened a new log
I20260808 16:01:09.929415 23320 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb6217931af4dd385497634742dbcd4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 41393 } }
I20260808 16:01:09.929622 23320 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:01:09.929657 23320 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb6217931af4dd385497634742dbcd4, State: Initialized, Role: FOLLOWER
I20260808 16:01:09.929967 23325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:09.922470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37887 (local address 127.19.93.62:41393)
0808 16:01:09.922855 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:09.922870 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:09.922903 (+ 33us) server_negotiation.cc:407] Connection header received
0808 16:01:09.923527 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:09.923546 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:09.923878 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:09.924249 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:09.924605 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:09.925521 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:09.926693 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:09.927165 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:09.927314 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:09.928329 (+ 1015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:09.928334 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:09.928345 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:01:09.928719 (+ 374us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:09.928771 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:01:09.928794 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:09.928867 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:09.929011 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 16:01:09.929197 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":104,"threads_started":1}
I20260808 16:01:09.930074 23320 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb6217931af4dd385497634742dbcd4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 41393 } }
I20260808 16:01:09.930222 23320 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:01:09.930287 23320 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:01:09.930389 23320 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:01:09.931159 23320 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb6217931af4dd385497634742dbcd4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 41393 } }
I20260808 16:01:09.931473 23320 leader_election.cc:302] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdb6217931af4dd385497634742dbcd4; no voters:
I20260808 16:01:09.931772 23320 leader_election.cc:288] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:01:09.931836 23329 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:01:09.932075 23329 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [term 1 LEADER]: Becoming Leader. State: Replica: bdb6217931af4dd385497634742dbcd4, State: Running, Role: LEADER
I20260808 16:01:09.932461 23329 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb6217931af4dd385497634742dbcd4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 41393 } }
I20260808 16:01:09.932624 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:01:09.933072 23320 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:01:09.934938 23331 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdb6217931af4dd385497634742dbcd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb6217931af4dd385497634742dbcd4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 41393 } } }
I20260808 16:01:09.935132 23331 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:09.935493 23330 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdb6217931af4dd385497634742dbcd4. Latest consensus state: current_term: 1 leader_uuid: "bdb6217931af4dd385497634742dbcd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb6217931af4dd385497634742dbcd4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 41393 } } }
I20260808 16:01:09.935583 23330 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4 [sys.catalog]: This master's current role is: LEADER
W20260808 16:01:09.938010 23363 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 16:01:09.938079 23363 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 16:01:09.938138 23364 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:01:09.938922 23364 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:01:09.940181 23325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:09.934901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59785 (local address 127.19.93.62:41393)
0808 16:01:09.934995 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:09.934999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:09.936134 (+ 1135us) server_negotiation.cc:407] Connection header received
0808 16:01:09.936223 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:09.936226 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:09.936267 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:09.936349 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:09.936700 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:09.937461 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:09.938538 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:09.938845 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:09.938952 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:09.939736 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:09.939739 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:09.939742 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:01:09.939755 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:09.939782 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:01:09.939794 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:09.939863 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:09.939975 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 16:01:09.940025 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 16:01:09.944397 23364 catalog_manager.cc:1347] Generated new cluster ID: f7dfde4a3e464e0a9f9cf7f3840a17a9
I20260808 16:01:09.944456 23364 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:01:09.957872 23364 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:01:09.958653 23364 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:01:09.962272 23364 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdb6217931af4dd385497634742dbcd4: Generated new TSK 0
I20260808 16:01:09.962822 23364 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:01:09.976979 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 23204
2026-08-08T16:01:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1503 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:01:10 dist-test-slave-lgr5 krb5kdc[23375](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:01:10 dist-test-slave-lgr5 krb5kdc[23375](info): set up 2 sockets
Aug 08 16:01:10 dist-test-slave-lgr5 krb5kdc[23375](info): commencing operation
krb5kdc: starting...
W20260808 16:01:11.149679 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:01:11 dist-test-slave-lgr5 krb5kdc[23375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:01:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:01:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 16:01:11.260869 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:35189
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:43485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:35189
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:01:11.367995 23398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:01:11.368266 23398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:01:11.368316 23398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:01:11.372136 23398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:01:11.372188 23398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:01:11.372208 23398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:01:11.372233 23398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:01:11.372251 23398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:01:11.377274 23398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:43485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:35189
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:35189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:01:11.378180 23398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:01:11.379123 23398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:01:11.387923 23413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:11.387923 23412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:11.388017 23398 server_base.cc:1034] running on GCE node
W20260808 16:01:11.387910 23415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:11.388682 23398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:01:11.389672 23398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:01:11.390832 23398 hybrid_clock.cc:648] HybridClock initialized: now 1786204871390807 us; error 35 us; skew 500 ppm
Aug 08 16:01:11 dist-test-slave-lgr5 krb5kdc[23375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204871, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:01:11.396996 23398 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 16:01:11.397801 23398 webserver.cc:460] Webserver started at http://127.19.93.62:41249/ using document root <none> and password file <none>
I20260808 16:01:11.398289 23398 fs_manager.cc:359] Metadata directory not provided
I20260808 16:01:11.398344 23398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:01:11.398509 23398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:01:11.400496 23398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "18825c9ff352446ab61fc36ddd806d0c"
format_stamp: "Formatted at 2026-08-08 16:01:11 on dist-test-slave-lgr5"
server_key: "ab6ec419d51a9c61b5ca75d8a938dcad"
server_key_iv: "e1455823f163d72db42c76af2a4b43bf"
server_key_version: "encryptionkey@0"
I20260808 16:01:11.401024 23398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "18825c9ff352446ab61fc36ddd806d0c"
format_stamp: "Formatted at 2026-08-08 16:01:11 on dist-test-slave-lgr5"
server_key: "ab6ec419d51a9c61b5ca75d8a938dcad"
server_key_iv: "e1455823f163d72db42c76af2a4b43bf"
server_key_version: "encryptionkey@0"
I20260808 16:01:11.404460 23398 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 16:01:11.406605 23430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:01:11.407701 23398 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:01:11.407799 23398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "18825c9ff352446ab61fc36ddd806d0c"
format_stamp: "Formatted at 2026-08-08 16:01:11 on dist-test-slave-lgr5"
server_key: "ab6ec419d51a9c61b5ca75d8a938dcad"
server_key_iv: "e1455823f163d72db42c76af2a4b43bf"
server_key_version: "encryptionkey@0"
I20260808 16:01:11.407877 23398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:01:11.412012 23398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:01:11.414487 23398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:01:11.414625 23398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:01:11.421294 23398 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:35189
I20260808 16:01:11.421337 23519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:35189 every 8 connection(s)
I20260808 16:01:11.422137 23398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:01:11.424818 23520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:01:11.425596 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 23398
I20260808 16:01:11.425740 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:01:11.426081 19828 external_mini_cluster.cc:1428] Setting key 8144ee33ff30b64b9fe05ff28312f687
I20260808 16:01:11.431382 23526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:11.427335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55519 (local address 127.19.93.62:35189)
0808 16:01:11.427749 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:11.427769 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:11.427825 (+ 56us) server_negotiation.cc:407] Connection header received
0808 16:01:11.428698 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:11.428721 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:11.429066 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:11.429417 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:11.430055 (+ 638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:11.430061 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:11.430074 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:01:11.430085 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:11.430141 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:01:11.430168 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:11.430311 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:11.430384 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 16:01:11.430529 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":105,"threads_started":1}
I20260808 16:01:11.431753 23520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c: Bootstrap starting.
I20260808 16:01:11.433900 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:01:11.433992 23520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c: Neither blocks nor log segments found. Creating new log.
I20260808 16:01:11.434866 23520 log.cc:824] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c: Log is configured to *not* fsync() on all Append() calls
I20260808 16:01:11.437119 23520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c: No bootstrap required, opened a new log
I20260808 16:01:11.437848 23526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:11.436241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56043 (local address 127.19.93.62:35189)
0808 16:01:11.436357 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:11.436362 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:11.436618 (+ 256us) server_negotiation.cc:407] Connection header received
0808 16:01:11.436739 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:11.436741 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:11.436769 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:11.436827 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:11.437512 (+ 685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:11.437515 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:11.437517 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 16:01:11.437527 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:11.437557 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 16:01:11.437567 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:11.437629 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:11.437734 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 16:01:11.437761 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 16:01:11.440959 23520 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18825c9ff352446ab61fc36ddd806d0c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35189 } }
I20260808 16:01:11.441171 23520 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 16:01:11.441231 23520 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18825c9ff352446ab61fc36ddd806d0c, State: Initialized, Role: FOLLOWER
I20260808 16:01:11.441632 23520 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18825c9ff352446ab61fc36ddd806d0c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35189 } }
I20260808 16:01:11.441761 23520 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 16:01:11.441831 23520 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 16:01:11.441931 23520 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:01:11.442799 23520 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18825c9ff352446ab61fc36ddd806d0c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35189 } }
I20260808 16:01:11.443120 23520 leader_election.cc:302] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18825c9ff352446ab61fc36ddd806d0c; no voters:
I20260808 16:01:11.443378 23520 leader_election.cc:288] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 16:01:11.443464 23537 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:01:11.443722 23537 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [term 1 LEADER]: Becoming Leader. State: Replica: 18825c9ff352446ab61fc36ddd806d0c, State: Running, Role: LEADER
I20260808 16:01:11.444023 23537 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18825c9ff352446ab61fc36ddd806d0c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35189 } }
I20260808 16:01:11.444643 23520 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:01:11.445660 23541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18825c9ff352446ab61fc36ddd806d0c. Latest consensus state: current_term: 1 leader_uuid: "18825c9ff352446ab61fc36ddd806d0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18825c9ff352446ab61fc36ddd806d0c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35189 } } }
I20260808 16:01:11.445796 23541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:11.446221 23551 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:01:11.446174 23540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18825c9ff352446ab61fc36ddd806d0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18825c9ff352446ab61fc36ddd806d0c" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 35189 } } }
I20260808 16:01:11.446291 23540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:11.449303 23551 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:01:11.454025 23551 catalog_manager.cc:1347] Generated new cluster ID: a0fc2a99622f47cdba3e9b54e16306a6
I20260808 16:01:11.454084 23551 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:01:11.487591 23551 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:01:11.487895 23551 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:01:11.495173 23551 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18825c9ff352446ab61fc36ddd806d0c: Generated new TSK 0
I20260808 16:01:11.495771 23551 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 16:01:11.502585 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 23398
2026-08-08T16:01:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1525 ms)
[----------] 18 tests from AuthTokenIssuingTest (27225 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:01:11 dist-test-slave-lgr5 krb5kdc[23567](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:01:11 dist-test-slave-lgr5 krb5kdc[23567](info): set up 2 sockets
Aug 08 16:01:11 dist-test-slave-lgr5 krb5kdc[23567](info): commencing operation
krb5kdc: starting...
W20260808 16:01:12.646783 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:01:12 dist-test-slave-lgr5 krb5kdc[23567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204872, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:01:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:01:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 16:01:12.759289 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:44393
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:39037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:44393,127.19.93.61:38691,127.19.93.60:46531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:01:12.866341 23587 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 16:01:12.866600 23587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:01:12.866622 23587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:01:12.866665 23587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:01:12.870553 23587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:01:12.870599 23587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:01:12.870617 23587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:01:12.870632 23587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:01:12.870649 23587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:01:12.875684 23587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:39037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:44393,127.19.93.61:38691,127.19.93.60:46531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:44393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:01:12.876655 23587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:01:12.877592 23587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:01:12.885735 23594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:12.885802 23587 server_base.cc:1034] running on GCE node
W20260808 16:01:12.885767 23597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:12.885921 23593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:12.886453 23587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:01:12.887498 23587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:01:12.888657 23587 hybrid_clock.cc:648] HybridClock initialized: now 1786204872888632 us; error 39 us; skew 500 ppm
Aug 08 16:01:12 dist-test-slave-lgr5 krb5kdc[23567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204872, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:01:12.891242 23587 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 16:01:12.892055 23587 webserver.cc:460] Webserver started at http://127.19.93.62:44243/ using document root <none> and password file <none>
I20260808 16:01:12.892585 23587 fs_manager.cc:359] Metadata directory not provided
I20260808 16:01:12.892643 23587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:01:12.892804 23587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:01:12.894726 23587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "c4af90c418654b1fa693158bde8622b5"
format_stamp: "Formatted at 2026-08-08 16:01:12 on dist-test-slave-lgr5"
server_key: "b59543b28b165806d14b3a876e82cfab"
server_key_iv: "c01a3c67cc823b5cd09fb610ef9338c1"
server_key_version: "encryptionkey@0"
I20260808 16:01:12.895248 23587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "c4af90c418654b1fa693158bde8622b5"
format_stamp: "Formatted at 2026-08-08 16:01:12 on dist-test-slave-lgr5"
server_key: "b59543b28b165806d14b3a876e82cfab"
server_key_iv: "c01a3c67cc823b5cd09fb610ef9338c1"
server_key_version: "encryptionkey@0"
I20260808 16:01:12.898669 23587 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 16:01:12.900854 23605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:01:12.901984 23587 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:01:12.902096 23587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "c4af90c418654b1fa693158bde8622b5"
format_stamp: "Formatted at 2026-08-08 16:01:12 on dist-test-slave-lgr5"
server_key: "b59543b28b165806d14b3a876e82cfab"
server_key_iv: "c01a3c67cc823b5cd09fb610ef9338c1"
server_key_version: "encryptionkey@0"
I20260808 16:01:12.902185 23587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:01:12.923952 23587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:01:12.926863 23587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:01:12.927028 23587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:01:12.933598 23587 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:44393
I20260808 16:01:12.933843 23701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:44393 every 8 connection(s)
I20260808 16:01:12.934521 23587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:01:12.937269 23702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:01:12.940867 23702 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } has no permanent_uuid. Determining permanent_uuid...
I20260808 16:01:12.944613 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 23587
I20260808 16:01:12.944738 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:01:12.945063 19828 external_mini_cluster.cc:1428] Setting key 9fbf6998a13c722cfb6110ad44a8e581
Aug 08 16:01:12 dist-test-slave-lgr5 krb5kdc[23567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204872, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.93.61@KRBTEST.COM; defaulting to no policy
I20260808 16:01:12.955916 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:12.942921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44393 (local address 127.0.0.1:40546)
0808 16:01:12.943370 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:12.943418 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:12.944263 (+ 845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:12.945008 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:12.945013 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:12.945384 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:12.945630 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:12.945643 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:12.947139 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:12.947143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:12.948232 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:12.948245 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:12.948870 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:12.948875 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:12.948995 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:12.949501 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:12.949520 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:12.951031 (+ 1511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:12.953088 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:12.953096 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:12.953103 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:12.953315 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:12.953657 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:12.953659 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:12.953661 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:12.953757 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:12.954512 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:12.954517 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:12.954640 (+ 123us) client_negotiation.cc:769] Sending connection context
0808 16:01:12.954781 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 16:01:12.955078 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":3,"thread_start_us":110,"threads_started":1}
I20260808 16:01:12.955921 23708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:12.942920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40546 (local address 127.19.93.62:44393)
0808 16:01:12.943302 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:12.943316 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:12.943511 (+ 195us) server_negotiation.cc:407] Connection header received
0808 16:01:12.944573 (+ 1062us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:12.944579 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:12.944809 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:12.944999 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:12.945779 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:12.946996 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:12.948346 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:12.948706 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:12.948823 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:12.951183 (+ 2360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:12.951190 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:12.951202 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:12.951228 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:12.952986 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:12.953423 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:12.953429 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:12.953431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:12.953568 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:12.953842 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:12.953845 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:12.953847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:12.954365 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:12.954504 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:12.954872 (+ 368us) server_negotiation.cc:299] Negotiation successful
0808 16:01:12.955247 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":206,"server-negotiator.queue_time_us":270,"spinlock_wait_cycles":31104,"thread_start_us":130,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.61@KRBTEST.COM" created.
I20260808 16:01:12.958173 23702 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } has no permanent_uuid. Determining permanent_uuid...
I20260808 16:01:12.958861 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:12.958587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:38691 (local address 127.0.0.1:57220)
0808 16:01:12.958708 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:12.958791 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:38691: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 16:01:12.959036 23614 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.93.61:38691: connect: Connection refused (error 111)
I20260808 16:01:12.959838 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:12.959661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:38691 (local address 127.0.0.1:57230)
0808 16:01:12.959748 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:12.959790 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:38691: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 16:01:12.959975 23702 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.61:38691: Network error: Client connection negotiation failed: client connection to 127.19.93.61:38691: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.61.keytab.
Entry for principal kudu/127.19.93.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.61.keytab.
I20260808 16:01:12.972347 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.61:38691
--webserver_interface=127.19.93.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.61.keytab
--principal=kudu/127.19.93.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:39037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:44393,127.19.93.61:38691,127.19.93.60:46531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 16:01:13.009222 23702 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } attempt: 1
I20260808 16:01:13.010085 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.009788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:38691 (local address 127.0.0.1:57236)
0808 16:01:13.009940 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.010003 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:38691: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 16:01:13.010767 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.010560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:38691 (local address 127.0.0.1:57244)
0808 16:01:13.010663 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.010709 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:38691: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 16:01:13.010885 23702 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.61:38691: Network error: Client connection negotiation failed: client connection to 127.19.93.61:38691: connect: Connection refused (error 111)
I20260808 16:01:13.079032 23702 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } attempt: 2
I20260808 16:01:13.079842 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.079565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:38691 (local address 127.0.0.1:57248)
0808 16:01:13.079708 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.079768 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:38691: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 16:01:13.080574 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.080339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:38691 (local address 127.0.0.1:57252)
0808 16:01:13.080442 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.080489 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:38691: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 16:01:13.080693 23702 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.61:38691: Network error: Client connection negotiation failed: client connection to 127.19.93.61:38691: connect: Connection refused (error 111)
W20260808 16:01:13.081519 23715 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 16:01:13.081791 23715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:01:13.081828 23715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:01:13.081882 23715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:01:13.085767 23715 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:01:13.085814 23715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:01:13.085841 23715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:01:13.085865 23715 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:01:13.085891 23715 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:01:13.090973 23715 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:39037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:44393,127.19.93.61:38691,127.19.93.60:46531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.61.keytab
--principal=kudu/127.19.93.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.61:38691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.93.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23715
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:01:13.091897 23715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:01:13.092841 23715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:01:13.100653 23724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:13.100652 23723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:13.100710 23726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:13.100916 23715 server_base.cc:1034] running on GCE node
I20260808 16:01:13.101377 23715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:01:13.102380 23715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:01:13.103539 23715 hybrid_clock.cc:648] HybridClock initialized: now 1786204873103522 us; error 26 us; skew 500 ppm
Aug 08 16:01:13 dist-test-slave-lgr5 krb5kdc[23567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204873, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:01:13.106124 23715 init.cc:377] Logged in from keytab as kudu/127.19.93.61@KRBTEST.COM (short username kudu)
I20260808 16:01:13.106925 23715 webserver.cc:460] Webserver started at http://127.19.93.61:46737/ using document root <none> and password file <none>
I20260808 16:01:13.107442 23715 fs_manager.cc:359] Metadata directory not provided
I20260808 16:01:13.107506 23715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:01:13.107697 23715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:01:13.109627 23715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/data/instance:
uuid: "2f46c1b0dab54827938fe79ac784bbf6"
format_stamp: "Formatted at 2026-08-08 16:01:13 on dist-test-slave-lgr5"
server_key: "9d2e5f86337690111ffb5729102dc9c8"
server_key_iv: "9b1dc23f3670d2b6cdeb71f07dd49f05"
server_key_version: "encryptionkey@0"
I20260808 16:01:13.110137 23715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/wal/instance:
uuid: "2f46c1b0dab54827938fe79ac784bbf6"
format_stamp: "Formatted at 2026-08-08 16:01:13 on dist-test-slave-lgr5"
server_key: "9d2e5f86337690111ffb5729102dc9c8"
server_key_iv: "9b1dc23f3670d2b6cdeb71f07dd49f05"
server_key_version: "encryptionkey@0"
I20260808 16:01:13.113514 23715 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 16:01:13.115690 23741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:01:13.116863 23715 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:01:13.116966 23715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/wal
uuid: "2f46c1b0dab54827938fe79ac784bbf6"
format_stamp: "Formatted at 2026-08-08 16:01:13 on dist-test-slave-lgr5"
server_key: "9d2e5f86337690111ffb5729102dc9c8"
server_key_iv: "9b1dc23f3670d2b6cdeb71f07dd49f05"
server_key_version: "encryptionkey@0"
I20260808 16:01:13.117056 23715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:01:13.133574 23715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:01:13.136044 23715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:01:13.136219 23715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:01:13.142628 23715 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.61:38691
I20260808 16:01:13.142922 23835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.61:38691 every 8 connection(s)
I20260808 16:01:13.143601 23715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/data/info.pb
I20260808 16:01:13.146189 23836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:01:13.148063 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 23715
I20260808 16:01:13.148213 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-1/wal/instance
I20260808 16:01:13.148468 19828 external_mini_cluster.cc:1428] Setting key b70475ac195cba3b35d17d033a07e3e2
I20260808 16:01:13.150004 23836 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.19.93.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.60@KRBTEST.COM" created.
Aug 08 16:01:13 dist-test-slave-lgr5 krb5kdc[23567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204873, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.61@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:01:13.164142 23708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.151982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40558 (local address 127.19.93.62:44393)
0808 16:01:13.152146 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.152150 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.153075 (+ 925us) server_negotiation.cc:407] Connection header received
0808 16:01:13.153955 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.153958 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.154023 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.154103 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.155237 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.155763 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.156943 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.157192 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.157291 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.160105 (+ 2814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:13.160110 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:13.160113 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:13.160140 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:13.162048 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.162547 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.162552 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.162553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.162653 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.162971 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.162974 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.162976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.163201 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:13.163311 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:13.163803 (+ 492us) server_negotiation.cc:299] Negotiation successful
0808 16:01:13.163948 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 16:01:13.164768 23839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.152437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44393 (local address 127.0.0.1:40558)
0808 16:01:13.152925 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.152972 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:13.153751 (+ 779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:13.154271 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:13.154277 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:13.154616 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:13.155092 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:13.155105 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.155889 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.155892 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:13.156818 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:13.156838 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.157356 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.157362 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:13.157570 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.158097 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:13.158113 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:13.159913 (+ 1800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:13.162160 (+ 2247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:13.162166 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:13.162179 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:13.162435 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:13.162747 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:13.162749 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:13.162750 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:13.162888 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:13.163294 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:13.163298 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:13.163559 (+ 261us) client_negotiation.cc:769] Sending connection context
0808 16:01:13.163707 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 16:01:13.163939 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":144,"threads_started":1}
I20260808 16:01:13.166234 23836 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 16:01:13 dist-test-slave-lgr5 krb5kdc[23567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204873, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.61@KRBTEST.COM for kudu/127.19.93.61@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.60.keytab.
Entry for principal kudu/127.19.93.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.60.keytab.
I20260808 16:01:13.171836 23702 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } attempt: 3
I20260808 16:01:13.172737 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.60:46531
--webserver_interface=127.19.93.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.60.keytab
--principal=kudu/127.19.93.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:39037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:44393,127.19.93.61:38691,127.19.93.60:46531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 16:01:13.174554 23839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.166695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:38691 (local address 127.0.0.1:57254)
0808 16:01:13.166805 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.166816 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:13.166882 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:13.167360 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:13.167363 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:13.167515 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:13.167585 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:13.167590 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.168534 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.168537 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:13.169058 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:13.169067 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.169599 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.169602 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:13.169686 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.170034 (+ 348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:13.170044 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:13.171091 (+ 1047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:13.173116 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:13.173119 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:13.173121 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:13.173291 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:13.173550 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:13.173553 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:13.173554 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:13.173625 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:13.174109 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:13.174111 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:13.174189 (+ 78us) client_negotiation.cc:769] Sending connection context
0808 16:01:13.174285 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 16:01:13.174409 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 16:01:13.174733 23845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.166788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57254 (local address 127.19.93.61:38691)
0808 16:01:13.167060 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.167068 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.167084 (+ 16us) server_negotiation.cc:407] Connection header received
0808 16:01:13.167114 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.167118 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.167247 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.167399 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.167682 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.168433 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.169159 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.169499 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.169587 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.171224 (+ 1637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:13.171233 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:13.171242 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:13.171284 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:13.173021 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.173383 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.173397 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.173399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.173472 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.173700 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.173704 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.173706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.173949 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:13.174075 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:13.174382 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 16:01:13.174524 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":107,"threads_started":1}
I20260808 16:01:13.176877 23836 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 16:01:13 dist-test-slave-lgr5 krb5kdc[23567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204872, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for kudu/127.19.93.61@KRBTEST.COM
I20260808 16:01:13.177541 23839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.177287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:46531 (local address 127.0.0.1:38494)
0808 16:01:13.177428 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.177490 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260808 16:01:13.177691 23743 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
I20260808 16:01:13.178676 23839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.178278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:46531 (local address 127.0.0.1:38510)
0808 16:01:13.178586 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.178627 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251}
W20260808 16:01:13.178799 23836 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:46531: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
I20260808 16:01:13.180620 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.172250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:38691 (local address 127.0.0.1:57256)
0808 16:01:13.172415 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.172428 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:13.172500 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:13.172967 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:13.172970 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:13.173126 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:13.173234 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:13.173242 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.174221 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.174224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:13.174973 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:13.174984 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.175438 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.175441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:13.175541 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.175937 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:13.175951 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:13.177262 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:13.179297 (+ 2035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:13.179299 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:13.179300 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:13.179487 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:13.179744 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:13.179746 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:13.179747 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:13.179808 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:13.180227 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:13.180229 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:13.180311 (+ 82us) client_negotiation.cc:769] Sending connection context
0808 16:01:13.180415 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 16:01:13.180515 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260808 16:01:13.180749 23848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.172320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57256 (local address 127.19.93.61:38691)
0808 16:01:13.172721 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.172730 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.172743 (+ 13us) server_negotiation.cc:407] Connection header received
0808 16:01:13.172775 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.172778 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.172817 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.173344 (+ 527us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.173433 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.174117 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.175089 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.175339 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.175424 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.177424 (+ 2000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:13.177428 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:13.177431 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:13.177456 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:13.179193 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.179576 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.179579 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.179581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.179666 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.179881 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.179884 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.179885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.180131 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:13.180233 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:13.180483 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 16:01:13.180596 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":94,"threads_started":1}
I20260808 16:01:13.181314 23702 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } has no permanent_uuid. Determining permanent_uuid...
I20260808 16:01:13.181929 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.181724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:46531 (local address 127.0.0.1:38514)
0808 16:01:13.181827 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.181872 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 16:01:13.182543 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.182332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:46531 (local address 127.0.0.1:38520)
0808 16:01:13.182462 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.182500 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260808 16:01:13.182648 23702 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:46531: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
I20260808 16:01:13.213786 23702 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } attempt: 1
I20260808 16:01:13.214509 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.214218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:46531 (local address 127.0.0.1:38528)
0808 16:01:13.214390 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.214445 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260808 16:01:13.215200 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.214993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:46531 (local address 127.0.0.1:38534)
0808 16:01:13.215107 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.215150 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 16:01:13.215309 23702 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:46531: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
I20260808 16:01:13.228040 23836 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } attempt: 1
I20260808 16:01:13.228750 23839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.228484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:46531 (local address 127.0.0.1:38536)
0808 16:01:13.228623 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.228680 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 16:01:13.229451 23839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.229228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:46531 (local address 127.0.0.1:38542)
0808 16:01:13.229331 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.229395 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 16:01:13.229568 23836 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:46531: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
W20260808 16:01:13.283401 23849 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 16:01:13.283663 23849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:01:13.283699 23849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:01:13.283756 23849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:01:13.287643 23849 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:01:13.287694 23849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:01:13.287720 23849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:01:13.287742 23849 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:01:13.287770 23849 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:01:13.290489 23702 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } attempt: 2
I20260808 16:01:13.291227 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.290958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:46531 (local address 127.0.0.1:38548)
0808 16:01:13.291094 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.291152 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 16:01:13.291917 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.291710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:46531 (local address 127.0.0.1:38554)
0808 16:01:13.291816 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.291859 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 16:01:13.292023 23702 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:46531: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
I20260808 16:01:13.293030 23849 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:39037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:44393,127.19.93.61:38691,127.19.93.60:46531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.60.keytab
--principal=kudu/127.19.93.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.60:46531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.93.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:01:13.293957 23849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:01:13.294893 23849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 16:01:13.297703 23836 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } attempt: 2
I20260808 16:01:13.298326 23839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.298103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:46531 (local address 127.0.0.1:38562)
0808 16:01:13.298215 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.298261 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 16:01:13.298918 23839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.298722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:46531 (local address 127.0.0.1:38572)
0808 16:01:13.298812 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.298861 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 16:01:13.299083 23836 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:46531: Network error: Client connection negotiation failed: client connection to 127.19.93.60:46531: connect: Connection refused (error 111)
W20260808 16:01:13.303079 23860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:13.303143 23864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:13.303092 23861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:13.303313 23849 server_base.cc:1034] running on GCE node
I20260808 16:01:13.303813 23849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:01:13.304829 23849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:01:13.305987 23849 hybrid_clock.cc:648] HybridClock initialized: now 1786204873305971 us; error 28 us; skew 500 ppm
Aug 08 16:01:13 dist-test-slave-lgr5 krb5kdc[23567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204873, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:01:13.308559 23849 init.cc:377] Logged in from keytab as kudu/127.19.93.60@KRBTEST.COM (short username kudu)
I20260808 16:01:13.309326 23849 webserver.cc:460] Webserver started at http://127.19.93.60:38223/ using document root <none> and password file <none>
I20260808 16:01:13.309813 23849 fs_manager.cc:359] Metadata directory not provided
I20260808 16:01:13.309865 23849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:01:13.310029 23849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:01:13.311832 23849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/data/instance:
uuid: "4bb85f913d1545d599afa89419910954"
format_stamp: "Formatted at 2026-08-08 16:01:13 on dist-test-slave-lgr5"
server_key: "160ca999aa5cf07616a7dd3196df08da"
server_key_iv: "69e91b87c9d701e6bed2a26e922c3156"
server_key_version: "encryptionkey@0"
I20260808 16:01:13.312389 23849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/wal/instance:
uuid: "4bb85f913d1545d599afa89419910954"
format_stamp: "Formatted at 2026-08-08 16:01:13 on dist-test-slave-lgr5"
server_key: "160ca999aa5cf07616a7dd3196df08da"
server_key_iv: "69e91b87c9d701e6bed2a26e922c3156"
server_key_version: "encryptionkey@0"
I20260808 16:01:13.315677 23849 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.002s
I20260808 16:01:13.317878 23872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:01:13.318982 23849 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:01:13.319092 23849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/wal
uuid: "4bb85f913d1545d599afa89419910954"
format_stamp: "Formatted at 2026-08-08 16:01:13 on dist-test-slave-lgr5"
server_key: "160ca999aa5cf07616a7dd3196df08da"
server_key_iv: "69e91b87c9d701e6bed2a26e922c3156"
server_key_version: "encryptionkey@0"
I20260808 16:01:13.319175 23849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:01:13.338795 23849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:01:13.341859 23849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:01:13.342022 23849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:01:13.348223 23849 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.60:46531
I20260808 16:01:13.348455 23968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.60:46531 every 8 connection(s)
I20260808 16:01:13.349088 23849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/data/info.pb
I20260808 16:01:13.350273 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 23849
I20260808 16:01:13.350428 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786204595622323-19828-0/minicluster-data/master-2/wal/instance
I20260808 16:01:13.350693 19828 external_mini_cluster.cc:1428] Setting key 3c2683b38076da5c3c8df71bbcf522f0
I20260808 16:01:13.351869 23971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:01:13.356297 23971 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 16:01:13 dist-test-slave-lgr5 krb5kdc[23567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204872, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.60@KRBTEST.COM
Aug 08 16:01:13 dist-test-slave-lgr5 krb5kdc[23567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204873, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.60@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:01:13.364599 23976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.351941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38580 (local address 127.19.93.60:46531)
0808 16:01:13.352364 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.352381 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.352421 (+ 40us) server_negotiation.cc:407] Connection header received
0808 16:01:13.353219 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.353242 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.353620 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.353953 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.354608 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.356058 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.356968 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.357615 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.357742 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.360341 (+ 2599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:13.360346 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:13.360357 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:13.360384 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:13.362001 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.362430 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.362435 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.362439 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.362534 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.362796 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.362800 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.362802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.363215 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:13.363398 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:13.363628 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 16:01:13.363866 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"spinlock_wait_cycles":15616,"thread_start_us":127,"threads_started":1}
I20260808 16:01:13.366624 23708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.358020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40570 (local address 127.19.93.62:44393)
0808 16:01:13.358170 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.358174 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.358515 (+ 341us) server_negotiation.cc:407] Connection header received
0808 16:01:13.358629 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.358632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.358680 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.358746 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.359429 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.359928 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.360998 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.361320 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.361478 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.363536 (+ 2058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:13.363539 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:13.363542 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:13.363570 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:13.365013 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.365453 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.365455 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.365456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.365538 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.365783 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.365785 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.365787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.366013 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:13.366107 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:13.366365 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 16:01:13.366472 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 16:01:13.366634 23978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.357986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:44393 (local address 127.0.0.1:40570)
0808 16:01:13.358385 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.358426 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:13.358544 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:13.358809 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:13.358815 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:13.359151 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:13.359293 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:13.359301 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.360059 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.360063 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:13.360882 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:13.360893 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.361473 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.361476 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:13.361564 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.361966 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:13.362003 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:13.363392 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:13.365105 (+ 1713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:13.365112 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:13.365117 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:13.365374 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:13.365620 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:13.365622 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:13.365623 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:13.365697 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:13.366100 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:13.366104 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:13.366192 (+ 88us) client_negotiation.cc:769] Sending connection context
0808 16:01:13.366303 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 16:01:13.366469 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"spinlock_wait_cycles":1408,"thread_start_us":159,"threads_started":1}
I20260808 16:01:13.367759 23971 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 16:01:13 dist-test-slave-lgr5 krb5kdc[23567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204872, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
Aug 08 16:01:13 dist-test-slave-lgr5 krb5kdc[23567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204873, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.60@KRBTEST.COM for kudu/127.19.93.61@KRBTEST.COM
I20260808 16:01:13.375092 23978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.368206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:38691 (local address 127.0.0.1:57258)
0808 16:01:13.368347 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.368359 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:13.368425 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:13.368666 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:13.368669 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:13.368811 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:13.368892 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:13.368897 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.369624 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.369627 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:13.370113 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:13.370120 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.370538 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.370542 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:13.370628 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.371008 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:13.371022 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:13.372187 (+ 1165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:13.373793 (+ 1606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:13.373796 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:13.373798 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:13.373971 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:13.374223 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:13.374226 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:13.374228 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:13.374303 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:13.374643 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:13.374646 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:13.374729 (+ 83us) client_negotiation.cc:769] Sending connection context
0808 16:01:13.374812 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 16:01:13.374925 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260808 16:01:13.375108 23708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.367226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40576 (local address 127.19.93.62:44393)
0808 16:01:13.367341 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.367345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.367360 (+ 15us) server_negotiation.cc:407] Connection header received
0808 16:01:13.367469 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.367472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.367511 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.367584 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.368119 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.368610 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.369330 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.369533 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.369617 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.371822 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:13.371825 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:13.371828 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:13.371854 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:13.373519 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.373895 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.373899 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.373900 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.373977 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.374211 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.374215 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.374216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.374416 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:13.374611 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:13.374762 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 16:01:13.374867 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 16:01:13.375125 23848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.368347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57258 (local address 127.19.93.61:38691)
0808 16:01:13.368469 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.368473 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.368496 (+ 23us) server_negotiation.cc:407] Connection header received
0808 16:01:13.368540 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.368542 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.368580 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.368641 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.369003 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.369527 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.370214 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.370443 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.370537 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.372326 (+ 1789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:13.372330 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:13.372332 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:13.372361 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:13.373704 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.374064 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.374067 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.374068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.374144 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.374383 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.374386 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.374388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.374556 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:13.374638 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:13.374873 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 16:01:13.374979 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 16:01:13.375869 23971 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 16:01:13 dist-test-slave-lgr5 krb5kdc[23567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204873, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.60@KRBTEST.COM for kudu/127.19.93.60@KRBTEST.COM
Aug 08 16:01:13 dist-test-slave-lgr5 krb5kdc[23567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204872, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.61@KRBTEST.COM
I20260808 16:01:13.384136 23978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.376283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:46531 (local address 127.0.0.1:38582)
0808 16:01:13.376437 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.376448 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:13.376528 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:13.376730 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:13.376733 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:13.376883 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:13.376969 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:13.376976 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.377826 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.377828 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:13.378519 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:13.378529 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.379568 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.379571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:13.379639 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.379914 (+ 275us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:13.379927 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:13.381126 (+ 1199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:13.382760 (+ 1634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:13.382763 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:13.382765 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:13.382938 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:13.383172 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:13.383175 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:13.383177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:13.383247 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:13.383638 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:13.383642 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:13.383735 (+ 93us) client_negotiation.cc:769] Sending connection context
0808 16:01:13.383834 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 16:01:13.383947 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103}
I20260808 16:01:13.384227 23976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.376343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38582 (local address 127.19.93.60:46531)
0808 16:01:13.376451 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.376454 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.376490 (+ 36us) server_negotiation.cc:407] Connection header received
0808 16:01:13.376602 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.376605 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.376643 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.376712 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.377079 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.377724 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.378625 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.379458 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.379531 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.381241 (+ 1710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:13.381245 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:13.381248 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:13.381269 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:13.382666 (+ 1397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.383017 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.383020 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.383022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.383093 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.383319 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.383322 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.383324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.383532 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:13.383631 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:13.383891 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 16:01:13.384015 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":41}
I20260808 16:01:13.384992 23848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.376258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57266 (local address 127.19.93.61:38691)
0808 16:01:13.376360 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.376364 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.376512 (+ 148us) server_negotiation.cc:407] Connection header received
0808 16:01:13.376602 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.376605 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.376643 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.376711 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.377320 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.377963 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.378902 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.379225 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.379319 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.381780 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:13.381783 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:13.381784 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:13.381805 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:13.383082 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.383654 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.383657 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.383659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.383741 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.384013 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.384016 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.384018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.384244 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:13.384438 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:13.384754 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 16:01:13.384853 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 16:01:13.387181 23971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954: Bootstrap starting.
I20260808 16:01:13.388128 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:01:13.389989 23971 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954: Neither blocks nor log segments found. Creating new log.
I20260808 16:01:13.390215 23836 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } attempt: 3
I20260808 16:01:13.389513 23652 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c4af90c418654b1fa693158bde8622b5"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40576
I20260808 16:01:13.390888 23971 log.cc:824] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954: Log is configured to *not* fsync() on all Append() calls
I20260808 16:01:13.391170 23702 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } attempt: 3
I20260808 16:01:13.393934 23971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954: No bootstrap required, opened a new log
Aug 08 16:01:13 dist-test-slave-lgr5 krb5kdc[23567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204873, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.61@KRBTEST.COM for kudu/127.19.93.60@KRBTEST.COM
Aug 08 16:01:13 dist-test-slave-lgr5 krb5kdc[23567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204872, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for kudu/127.19.93.60@KRBTEST.COM
I20260808 16:01:13.397696 23971 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } }
I20260808 16:01:13.397955 23971 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85f913d1545d599afa89419910954, State: Initialized, Role: FOLLOWER
I20260808 16:01:13.398272 23971 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } }
I20260808 16:01:13.398877 23984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } } }
I20260808 16:01:13.399219 23984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 16:01:13.399653 23971 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:01:13.400925 23839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.391217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:46531 (local address 127.0.0.1:38592)
0808 16:01:13.391373 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.391387 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:13.391458 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:13.391852 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:13.391856 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:13.392235 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:13.392357 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:13.392365 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.393130 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.393134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:13.393912 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:13.393922 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.394540 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.394544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:13.394644 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.395215 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:13.395232 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:13.397238 (+ 2006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:13.399172 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:13.399175 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:13.399177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:13.399425 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:13.399727 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:13.399731 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:13.399733 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:13.399822 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:13.400272 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:13.400275 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:13.400363 (+ 88us) client_negotiation.cc:769] Sending connection context
0808 16:01:13.400646 (+ 283us) client_negotiation.cc:240] Negotiation successful
0808 16:01:13.400778 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94}
I20260808 16:01:13.401321 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.391738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:46531 (local address 127.0.0.1:38598)
0808 16:01:13.391903 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:13.391916 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:13.391994 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:13.392323 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:13.392326 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:13.392500 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:13.392589 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:13.392596 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.393709 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.393725 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:13.394319 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:13.394328 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.394915 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.394918 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:13.395002 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.395778 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:13.395792 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:13.397237 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:13.399566 (+ 2329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:13.399569 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:13.399571 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:13.399787 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:13.400068 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:13.400071 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:13.400073 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:13.400191 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:13.400828 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:13.400831 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:13.400928 (+ 97us) client_negotiation.cc:769] Sending connection context
0808 16:01:13.401044 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 16:01:13.401175 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260808 16:01:13.401471 23976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.391497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38592 (local address 127.19.93.60:46531)
0808 16:01:13.391610 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.391614 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.391625 (+ 11us) server_negotiation.cc:407] Connection header received
0808 16:01:13.391657 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.391660 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.391700 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.392470 (+ 770us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.392567 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.393026 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.394083 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.394368 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.394516 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.397392 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:13.397396 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:13.397399 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:13.397423 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:13.399053 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.399546 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.399549 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.399550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.399628 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.399928 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.399931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.399933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.400156 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:13.401181 (+ 1025us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:13.401252 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 16:01:13.401348 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 16:01:13.402005 23982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.391661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38598 (local address 127.19.93.60:46531)
0808 16:01:13.392070 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.392112 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.392127 (+ 15us) server_negotiation.cc:407] Connection header received
0808 16:01:13.392173 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.392176 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.392216 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.392295 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.392734 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.393613 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.394426 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.394770 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.394899 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.397708 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:13.397711 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:13.397714 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:13.397736 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:13.399473 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.399882 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.399885 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.399887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.399968 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.400283 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.400286 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.400288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.400665 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:13.400840 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:13.401603 (+ 763us) server_negotiation.cc:299] Negotiation successful
0808 16:01:13.401707 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":113,"threads_started":1}
I20260808 16:01:13.404527 23836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6: Bootstrap starting.
W20260808 16:01:13.404876 24000 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 16:01:13.404937 24000 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 16:01:13.403157 23849 master_runner.cc:186] Error getting master registration for 127.19.93.62:44393: OK, instance_id { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" instance_seqno: 1786204872931753 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 16:01:13.406229 23849 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 16:01:13.406747 23702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5: Bootstrap starting.
I20260808 16:01:13.407107 23836 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6: Neither blocks nor log segments found. Creating new log.
I20260808 16:01:13.407927 23836 log.cc:824] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6: Log is configured to *not* fsync() on all Append() calls
I20260808 16:01:13.408623 23702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5: Neither blocks nor log segments found. Creating new log.
I20260808 16:01:13.409252 23702 log.cc:824] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5: Log is configured to *not* fsync() on all Append() calls
I20260808 16:01:13.410027 23836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6: No bootstrap required, opened a new log
I20260808 16:01:13.411094 23702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5: No bootstrap required, opened a new log
I20260808 16:01:13.413810 23702 raft_consensus.cc:348] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } }
I20260808 16:01:13.414014 23702 raft_consensus.cc:729] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af90c418654b1fa693158bde8622b5, State: Initialized, Role: FOLLOWER
I20260808 16:01:13.413879 23836 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } }
I20260808 16:01:13.414103 23836 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f46c1b0dab54827938fe79ac784bbf6, State: Initialized, Role: FOLLOWER
I20260808 16:01:13.414323 23702 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } }
I20260808 16:01:13.414420 23836 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } }
I20260808 16:01:13.414950 24006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } } }
I20260808 16:01:13.415280 24006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 16:01:13.415616 23702 sys_catalog.cc:564] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:01:13.415663 23652 raft_consensus.cc:482] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 16:01:13.415663 23836 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:01:13.415751 23652 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:01:13.416996 23652 raft_consensus.cc:504] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } }
I20260808 16:01:13.418830 23794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c4af90c418654b1fa693158bde8622b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2f46c1b0dab54827938fe79ac784bbf6"
I20260808 16:01:13.418838 23921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c4af90c418654b1fa693158bde8622b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4bb85f913d1545d599afa89419910954"
I20260808 16:01:13.419036 23921 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:01:13.419035 23794 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:01:13.420280 23794 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4af90c418654b1fa693158bde8622b5 in term 1.
I20260808 16:01:13.420280 23921 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4af90c418654b1fa693158bde8622b5 in term 1.
I20260808 16:01:13.420725 23606 leader_election.cc:302] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85f913d1545d599afa89419910954, c4af90c418654b1fa693158bde8622b5; no voters:
I20260808 16:01:13.417923 23652 leader_election.cc:288] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [CANDIDATE]: Term 1 election: Requested vote from peers 2f46c1b0dab54827938fe79ac784bbf6 (127.19.93.61:38691), 4bb85f913d1545d599afa89419910954 (127.19.93.60:46531)
W20260808 16:01:13.421309 24036 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 16:01:13.421375 24036 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 16:01:13.425335 23715 master_runner.cc:263] No leader master found from master 2f46c1b0dab54827938fe79ac784bbf6
I20260808 16:01:13.425400 23715 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 16:01:13.426141 23587 master_runner.cc:263] No leader master found from master c4af90c418654b1fa693158bde8622b5
I20260808 16:01:13.426196 23587 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 16:01:13.427053 24027 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 16:01:13.427116 24027 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 16:01:13.427306 24039 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } } }
I20260808 16:01:13.427394 24039 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 16:01:13.427464 24039 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:01:13.427529 24039 raft_consensus.cc:686] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [term 1 LEADER]: Becoming Leader. State: Replica: c4af90c418654b1fa693158bde8622b5, State: Running, Role: LEADER
I20260808 16:01:13.427791 24039 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } }
W20260808 16:01:13.428417 23616 tablet.cc:2369] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 16:01:13.429984 24004 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4af90c418654b1fa693158bde8622b5. Latest consensus state: current_term: 1 leader_uuid: "c4af90c418654b1fa693158bde8622b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } } }
I20260808 16:01:13.430099 24004 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:13.433638 24051 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:01:13.434515 24051 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:01:13.439677 23921 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954 [term 1 FOLLOWER]: Refusing update from remote peer c4af90c418654b1fa693158bde8622b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 16:01:13.440378 24004 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 16:01:13.443912 23984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4af90c418654b1fa693158bde8622b5. Latest consensus state: current_term: 1 leader_uuid: "c4af90c418654b1fa693158bde8622b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } } }
I20260808 16:01:13.444015 23984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 16:01:13.444942 23794 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6 [term 1 FOLLOWER]: Refusing update from remote peer c4af90c418654b1fa693158bde8622b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 16:01:13.445498 24004 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 16:01:13.446564 23848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.428445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57270 (local address 127.19.93.61:38691)
0808 16:01:13.428568 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.428573 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.437280 (+ 8707us) server_negotiation.cc:407] Connection header received
0808 16:01:13.437721 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.437725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.437769 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.437816 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.438783 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.439594 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.440796 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.441126 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.441197 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.443023 (+ 1826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:13.443027 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:13.443030 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:13.443057 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:13.444714 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.445180 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.445184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.445186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.445269 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.445604 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.445608 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.445610 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.445831 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:13.445934 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:13.446285 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 16:01:13.446397 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 16:01:13.449922 24006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4af90c418654b1fa693158bde8622b5. Latest consensus state: current_term: 1 leader_uuid: "c4af90c418654b1fa693158bde8622b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } } }
I20260808 16:01:13.450058 24006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 16:01:13.457159 23984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c4af90c418654b1fa693158bde8622b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } } }
I20260808 16:01:13.457274 23984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 16:01:13.457633 24004 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c4af90c418654b1fa693158bde8622b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } } }
I20260808 16:01:13.457731 24004 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:13.457850 24052 mvcc.cc:205] Tried to move back new op lower bound from 7316295161602019328 to 7316295161563828224. Current Snapshot: MvccSnapshot[applied={T|T < 7316295161602019328}]
I20260808 16:01:13.459671 24057 mvcc.cc:205] Tried to move back new op lower bound from 7316295161602019328 to 7316295161563828224. Current Snapshot: MvccSnapshot[applied={T|T < 7316295161602019328}]
I20260808 16:01:13.460239 23708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.436393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40578 (local address 127.19.93.62:44393)
0808 16:01:13.436508 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.436512 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.443773 (+ 7261us) server_negotiation.cc:407] Connection header received
0808 16:01:13.443953 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.443956 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.444019 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.444074 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.446088 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.446755 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.450698 (+ 3943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.451061 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.451135 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.454217 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:13.454221 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:13.454224 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:13.454250 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:13.455840 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.458478 (+ 2638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.458481 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.458483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.458570 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.458848 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.458852 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.458854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.459064 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:13.459168 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:13.459942 (+ 774us) server_negotiation.cc:299] Negotiation successful
0808 16:01:13.460070 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 16:01:13.461570 24004 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c4af90c418654b1fa693158bde8622b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } } }
I20260808 16:01:13.461669 24004 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5 [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:13.462337 23982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:13.437011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38608 (local address 127.19.93.60:46531)
0808 16:01:13.437115 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.437119 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.445039 (+ 7920us) server_negotiation.cc:407] Connection header received
0808 16:01:13.445201 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.445204 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.445251 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.445301 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.447804 (+ 2503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.448595 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.449675 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:13.450021 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:13.450100 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:13.456362 (+ 6262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:13.456366 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:13.456369 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:13.456395 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:13.457970 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.459465 (+ 1495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.459469 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.459471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.459560 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:13.460689 (+ 1129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:13.460693 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:13.460695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:13.460905 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:13.461015 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:13.462077 (+ 1062us) server_negotiation.cc:299] Negotiation successful
0808 16:01:13.462196 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 16:01:13.462653 24006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c4af90c418654b1fa693158bde8622b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af90c418654b1fa693158bde8622b5" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 44393 } } peers { permanent_uuid: "2f46c1b0dab54827938fe79ac784bbf6" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 38691 } } peers { permanent_uuid: "4bb85f913d1545d599afa89419910954" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 46531 } } }
I20260808 16:01:13.462749 24006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 16:01:13.463284 24061 mvcc.cc:205] Tried to move back new op lower bound from 7316295161602019328 to 7316295161563828224. Current Snapshot: MvccSnapshot[applied={T|T < 7316295161602019328}]
I20260808 16:01:13.468205 24051 catalog_manager.cc:1347] Generated new cluster ID: b7582cde38a24c3185de5e12fe1c799f
I20260808 16:01:13.468266 24051 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:01:13.492877 24051 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:01:13.494159 24051 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:01:13.508303 24051 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c4af90c418654b1fa693158bde8622b5: Generated new TSK 0
I20260808 16:01:13.509143 24051 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 16:01:13.539390 23848 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:13.537634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57284 (local address 127.19.93.61:38691)
0808 16:01:13.537750 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.537755 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.538379 (+ 624us) server_negotiation.cc:407] Connection header received
0808 16:01:13.538574 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.538578 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.538626 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.538678 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.539255 (+ 577us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57284: BlockingRecv error: recv got EOF from 127.0.0.1:57284 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260808 16:01:13.541452 23708 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:13.540010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40594 (local address 127.19.93.62:44393)
0808 16:01:13.540139 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.540143 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.540603 (+ 460us) server_negotiation.cc:407] Connection header received
0808 16:01:13.540755 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.540759 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.540804 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.540862 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.541340 (+ 478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40594: BlockingRecv error: recv got EOF from 127.0.0.1:40594 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260808 16:01:13.542860 23982 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:13.540532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38618 (local address 127.19.93.60:46531)
0808 16:01:13.540664 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.540668 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.542033 (+ 1365us) server_negotiation.cc:407] Connection header received
0808 16:01:13.542188 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.542191 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.542236 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.542285 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.542734 (+ 449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38618: BlockingRecv error: recv got EOF from 127.0.0.1:38618 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 16:01:13.547014 23848 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:13.545501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57300 (local address 127.19.93.61:38691)
0808 16:01:13.545595 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.545599 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.546081 (+ 482us) server_negotiation.cc:407] Connection header received
0808 16:01:13.546288 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.546292 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.546367 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.546419 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.546914 (+ 495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57300: BlockingRecv error: recv got EOF from 127.0.0.1:57300 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 16:01:13.551658 23848 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:13.550212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57312 (local address 127.19.93.61:38691)
0808 16:01:13.550306 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.550310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.550816 (+ 506us) server_negotiation.cc:407] Connection header received
0808 16:01:13.551010 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.551014 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.551059 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.551107 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.551575 (+ 468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57312: BlockingRecv error: recv got EOF from 127.0.0.1:57312 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 16:01:13.556977 23848 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:13.555458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57322 (local address 127.19.93.61:38691)
0808 16:01:13.555575 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.555579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.556167 (+ 588us) server_negotiation.cc:407] Connection header received
0808 16:01:13.556351 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.556354 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.556396 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.556442 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.556894 (+ 452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57322: BlockingRecv error: recv got EOF from 127.0.0.1:57322 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 16:01:13.564126 23848 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:13.562651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57326 (local address 127.19.93.61:38691)
0808 16:01:13.562770 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.562774 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.563278 (+ 504us) server_negotiation.cc:407] Connection header received
0808 16:01:13.563452 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.563455 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.563497 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.563541 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.564012 (+ 471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57326: BlockingRecv error: recv got EOF from 127.0.0.1:57326 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 16:01:13.575472 23848 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:13.573932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57330 (local address 127.19.93.61:38691)
0808 16:01:13.574028 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.574032 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.574560 (+ 528us) server_negotiation.cc:407] Connection header received
0808 16:01:13.574753 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.574756 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.574803 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.574868 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.575384 (+ 516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57330: BlockingRecv error: recv got EOF from 127.0.0.1:57330 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260808 16:01:13.596208 23848 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:13.594570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57340 (local address 127.19.93.61:38691)
0808 16:01:13.594678 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.594683 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.595254 (+ 571us) server_negotiation.cc:407] Connection header received
0808 16:01:13.595444 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.595448 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.595496 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.595543 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.596051 (+ 508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57340: BlockingRecv error: recv got EOF from 127.0.0.1:57340 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260808 16:01:13.631335 23848 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:13.630289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57354 (local address 127.19.93.61:38691)
0808 16:01:13.630434 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.630439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.630539 (+ 100us) server_negotiation.cc:407] Connection header received
0808 16:01:13.630665 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.630668 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.630723 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.630819 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.631218 (+ 399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57354: BlockingRecv error: recv got EOF from 127.0.0.1:57354 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260808 16:01:13.698347 23848 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:13.697290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57370 (local address 127.19.93.61:38691)
0808 16:01:13.697436 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.697439 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.697559 (+ 120us) server_negotiation.cc:407] Connection header received
0808 16:01:13.697709 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.697712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.697774 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.697884 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.698246 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57370: BlockingRecv error: recv got EOF from 127.0.0.1:57370 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 16:01:13.829452 23848 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:13.828422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57374 (local address 127.19.93.61:38691)
0808 16:01:13.828557 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:13.828561 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:13.828678 (+ 117us) server_negotiation.cc:407] Connection header received
0808 16:01:13.828806 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:13.828808 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:13.828856 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:13.828949 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:13.829342 (+ 393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57374: BlockingRecv error: recv got EOF from 127.0.0.1:57374 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 16:01:14.088634 23848 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:14.087506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57384 (local address 127.19.93.61:38691)
0808 16:01:14.087654 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:14.087659 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:14.087723 (+ 64us) server_negotiation.cc:407] Connection header received
0808 16:01:14.087895 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:14.087898 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:14.087946 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:14.088016 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:14.088533 (+ 517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57384: BlockingRecv error: recv got EOF from 127.0.0.1:57384 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 16:01:14.406224 24000 catalog_manager.cc:1259] Loaded cluster ID: b7582cde38a24c3185de5e12fe1c799f
I20260808 16:01:14.406301 24000 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954: loading cluster ID for follower catalog manager: success
I20260808 16:01:14.407974 24000 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954: acquiring CA information for follower catalog manager: success
I20260808 16:01:14.409137 24000 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4bb85f913d1545d599afa89419910954: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 16:01:14.422451 24036 catalog_manager.cc:1259] Loaded cluster ID: b7582cde38a24c3185de5e12fe1c799f
I20260808 16:01:14.422509 24036 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6: loading cluster ID for follower catalog manager: success
I20260808 16:01:14.424118 24036 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6: acquiring CA information for follower catalog manager: success
I20260808 16:01:14.425124 24036 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2f46c1b0dab54827938fe79ac784bbf6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 16:01:14.606696 24170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:14.602789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57388 (local address 127.19.93.61:38691)
0808 16:01:14.603070 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:14.603075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:14.603108 (+ 33us) server_negotiation.cc:407] Connection header received
0808 16:01:14.603269 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:14.603273 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:14.603422 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:14.603521 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 16:01:14.603793 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:14.604344 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:14.605216 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:14.605440 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:14.605532 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:14.605856 (+ 324us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 16:01:14.606298 (+ 442us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 16:01:14.606411 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:14.606481 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 16:01:14.606541 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":80,"threads_started":1}
I20260808 16:01:14.612996 24183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:14.609730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38622 (local address 127.19.93.60:46531)
0808 16:01:14.609925 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:14.609929 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:14.609942 (+ 13us) server_negotiation.cc:407] Connection header received
0808 16:01:14.610105 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:14.610107 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:14.610214 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:14.610302 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 16:01:14.610475 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:14.610956 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:14.611736 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:14.611939 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:14.612002 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:14.612281 (+ 279us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 16:01:14.612657 (+ 376us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 16:01:14.612742 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:14.612837 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 16:01:14.612881 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":59,"threads_started":1}
I20260808 16:01:14.619202 24170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:14.615741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57402 (local address 127.19.93.61:38691)
0808 16:01:14.615852 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:14.615856 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:14.616133 (+ 277us) server_negotiation.cc:407] Connection header received
0808 16:01:14.616292 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:14.616295 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:14.616342 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:14.616401 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 16:01:14.616674 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:14.617148 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:14.618143 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:14.618412 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:14.618511 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:14.618810 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 16:01:14.618876 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 16:01:14.618935 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:14.619025 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 16:01:14.619075 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 16:01:14.620651 24183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:14.616151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38636 (local address 127.19.93.60:46531)
0808 16:01:14.616257 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:14.616261 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:14.617396 (+ 1135us) server_negotiation.cc:407] Connection header received
0808 16:01:14.617484 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:14.617487 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:14.617535 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:14.617611 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 16:01:14.617813 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:14.618384 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:14.619515 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:14.619801 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:14.619895 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:14.620240 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 16:01:14.620318 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 16:01:14.620376 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:14.620476 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 16:01:14.620536 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 16:01:14.620960 24194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:14.615782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40600 (local address 127.19.93.62:44393)
0808 16:01:14.616450 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:14.616454 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:14.616467 (+ 13us) server_negotiation.cc:407] Connection header received
0808 16:01:14.616600 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:14.616603 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:14.616769 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:14.617007 (+ 238us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 16:01:14.617288 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:14.618027 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:14.619571 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:14.619794 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:14.619878 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:14.620236 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 16:01:14.620523 (+ 287us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 16:01:14.620611 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:14.620693 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 16:01:14.620842 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":89,"threads_started":1}
I20260808 16:01:14.623602 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 23587
I20260808 16:01:14.639830 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 23715
I20260808 16:01:14.649868 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 23849
2026-08-08T16:01:14Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3144 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 16:01:14 dist-test-slave-lgr5 krb5kdc[24201](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 16:01:14 dist-test-slave-lgr5 krb5kdc[24201](info): set up 2 sockets
Aug 08 16:01:14 dist-test-slave-lgr5 krb5kdc[24201](info): commencing operation
krb5kdc: starting...
W20260808 16:01:15.790679 19828 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/test-user.keytab.
Aug 08 16:01:15 dist-test-slave-lgr5 krb5kdc[24201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T16:01:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T16:01:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.93.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
Entry for principal kudu/127.19.93.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab.
I20260808 16:01:15.904716 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:39619
--webserver_interface=127.19.93.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:39081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:39619,127.19.93.61:41159,127.19.93.60:33157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 16:01:16.013643 24221 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 16:01:16.013901 24221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:01:16.013924 24221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:01:16.013967 24221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 16:01:16.017825 24221 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:01:16.017872 24221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:01:16.017896 24221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:01:16.017911 24221 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:01:16.017927 24221 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:01:16.022976 24221 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:39081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:39619,127.19.93.61:41159,127.19.93.60:33157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.62.keytab
--principal=kudu/127.19.93.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.62:39619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.93.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:01:16.023854 24221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:01:16.024827 24221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:01:16.032732 24227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:16.032724 24230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:16.032706 24228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:16.032786 24221 server_base.cc:1034] running on GCE node
I20260808 16:01:16.033407 24221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:01:16.034411 24221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:01:16.035560 24221 hybrid_clock.cc:648] HybridClock initialized: now 1786204876035540 us; error 37 us; skew 500 ppm
Aug 08 16:01:16 dist-test-slave-lgr5 krb5kdc[24201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204876, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:01:16.038167 24221 init.cc:377] Logged in from keytab as kudu/127.19.93.62@KRBTEST.COM (short username kudu)
I20260808 16:01:16.038980 24221 webserver.cc:460] Webserver started at http://127.19.93.62:35381/ using document root <none> and password file <none>
I20260808 16:01:16.039456 24221 fs_manager.cc:359] Metadata directory not provided
I20260808 16:01:16.039510 24221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:01:16.039667 24221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:01:16.041591 24221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/data/instance:
uuid: "6af5a60c68e1425a9823af3108871fe4"
format_stamp: "Formatted at 2026-08-08 16:01:16 on dist-test-slave-lgr5"
server_key: "6da6faa9b557fa535d2283b41df8a81d"
server_key_iv: "3a19937df20da56ff652f4fdd7588c4b"
server_key_version: "encryptionkey@0"
I20260808 16:01:16.042081 24221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/wal/instance:
uuid: "6af5a60c68e1425a9823af3108871fe4"
format_stamp: "Formatted at 2026-08-08 16:01:16 on dist-test-slave-lgr5"
server_key: "6da6faa9b557fa535d2283b41df8a81d"
server_key_iv: "3a19937df20da56ff652f4fdd7588c4b"
server_key_version: "encryptionkey@0"
I20260808 16:01:16.045431 24221 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 16:01:16.047605 24238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:01:16.048816 24221 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 16:01:16.048945 24221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/wal
uuid: "6af5a60c68e1425a9823af3108871fe4"
format_stamp: "Formatted at 2026-08-08 16:01:16 on dist-test-slave-lgr5"
server_key: "6da6faa9b557fa535d2283b41df8a81d"
server_key_iv: "3a19937df20da56ff652f4fdd7588c4b"
server_key_version: "encryptionkey@0"
I20260808 16:01:16.049033 24221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:01:16.062901 24221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:01:16.065666 24221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:01:16.065827 24221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:01:16.072283 24221 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.62:39619
I20260808 16:01:16.072543 24325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.62:39619 every 8 connection(s)
I20260808 16:01:16.073143 24221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/data/info.pb
I20260808 16:01:16.075716 24326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:01:16.079218 24326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } has no permanent_uuid. Determining permanent_uuid...
I20260808 16:01:16.080116 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 24221
I20260808 16:01:16.080219 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-0/wal/instance
I20260808 16:01:16.080520 19828 external_mini_cluster.cc:1428] Setting key 478cd0839f7dd0797708a99e37d28237
Aug 08 16:01:16 dist-test-slave-lgr5 krb5kdc[24201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204876, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.93.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.61@KRBTEST.COM" created.
I20260808 16:01:16.093770 24332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.081421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58152 (local address 127.19.93.62:39619)
0808 16:01:16.081847 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.081864 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.082149 (+ 285us) server_negotiation.cc:407] Connection header received
0808 16:01:16.083119 (+ 970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.083125 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.083359 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.083559 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.084547 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.085450 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.086871 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.087222 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.087326 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.089708 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:16.089713 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:16.089721 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:16.089742 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:16.091021 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.091442 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.091447 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.091449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.091562 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.091846 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.091849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.091851 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.092314 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:16.092456 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:16.092841 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 16:01:16.093043 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":278,"thread_start_us":124,"threads_started":1}
I20260808 16:01:16.093767 24335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.081421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:39619 (local address 127.0.0.1:58152)
0808 16:01:16.081989 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.082035 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:16.082831 (+ 796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:16.083637 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:16.083643 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:16.084060 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:16.084413 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.084431 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.085580 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.085583 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.086761 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.086774 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.087363 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.087367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.087494 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.088022 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:16.088053 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:16.089578 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:16.091119 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.091127 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.091136 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.091339 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.091656 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.091659 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.091661 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.091765 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.092436 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:16.092442 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:16.092600 (+ 158us) client_negotiation.cc:769] Sending connection context
0808 16:01:16.092777 (+ 177us) client_negotiation.cc:240] Negotiation successful
0808 16:01:16.093132 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"mutex_wait_us":76,"spinlock_wait_cycles":9472,"thread_start_us":150,"threads_started":1}
I20260808 16:01:16.095902 24326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } has no permanent_uuid. Determining permanent_uuid...
I20260808 16:01:16.096593 24335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.096363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:41159 (local address 127.0.0.1:60146)
0808 16:01:16.096472 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.096536 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:41159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 16:01:16.096765 24240 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.93.61:41159: connect: Connection refused (error 111)
I20260808 16:01:16.097491 24335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.097307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:41159 (local address 127.0.0.1:60160)
0808 16:01:16.097400 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.097443 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:41159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 16:01:16.097635 24326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.61:41159: Network error: Client connection negotiation failed: client connection to 127.19.93.61:41159: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.61.keytab.
Entry for principal kudu/127.19.93.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.61.keytab.
I20260808 16:01:16.106191 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.61:41159
--webserver_interface=127.19.93.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.61.keytab
--principal=kudu/127.19.93.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:39081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:39619,127.19.93.61:41159,127.19.93.60:33157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 16:01:16.146839 24326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } attempt: 1
I20260808 16:01:16.147727 24335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.147367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:41159 (local address 127.0.0.1:60172)
0808 16:01:16.147545 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.147625 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:41159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 16:01:16.148554 24335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.148319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:41159 (local address 127.0.0.1:60182)
0808 16:01:16.148424 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.148481 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:41159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 16:01:16.148685 24326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.61:41159: Network error: Client connection negotiation failed: client connection to 127.19.93.61:41159: connect: Connection refused (error 111)
W20260808 16:01:16.214213 24339 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 16:01:16.214457 24339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:01:16.214479 24339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:01:16.214516 24339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 16:01:16.216866 24326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } attempt: 2
I20260808 16:01:16.217665 24335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.217350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:41159 (local address 127.0.0.1:60192)
0808 16:01:16.217507 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.217576 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:41159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 16:01:16.218321 24335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.218129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:41159 (local address 127.0.0.1:60200)
0808 16:01:16.218214 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.218260 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.61:41159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 16:01:16.218427 24326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.61:41159: Network error: Client connection negotiation failed: client connection to 127.19.93.61:41159: connect: Connection refused (error 111)
W20260808 16:01:16.218685 24339 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:01:16.218724 24339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:01:16.218753 24339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:01:16.218784 24339 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:01:16.218813 24339 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:01:16.223871 24339 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:39081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:39619,127.19.93.61:41159,127.19.93.60:33157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.61.keytab
--principal=kudu/127.19.93.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.61:41159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.93.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:01:16.224786 24339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:01:16.225689 24339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 16:01:16.233151 24346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:16.233150 24350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:16.233208 24345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:16.233421 24339 server_base.cc:1034] running on GCE node
I20260808 16:01:16.233914 24339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:01:16.234885 24339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:01:16.236027 24339 hybrid_clock.cc:648] HybridClock initialized: now 1786204876236005 us; error 39 us; skew 500 ppm
Aug 08 16:01:16 dist-test-slave-lgr5 krb5kdc[24201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204876, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:01:16.238526 24339 init.cc:377] Logged in from keytab as kudu/127.19.93.61@KRBTEST.COM (short username kudu)
I20260808 16:01:16.239317 24339 webserver.cc:460] Webserver started at http://127.19.93.61:37227/ using document root <none> and password file <none>
I20260808 16:01:16.239799 24339 fs_manager.cc:359] Metadata directory not provided
I20260808 16:01:16.239856 24339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:01:16.240015 24339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:01:16.241971 24339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/data/instance:
uuid: "fafd453adb554f5b88bf3cd358a3372d"
format_stamp: "Formatted at 2026-08-08 16:01:16 on dist-test-slave-lgr5"
server_key: "e0404c0a61660810ef87eb06ae6406a6"
server_key_iv: "9c1fcb84bb3aa0f44e0997088dec2a67"
server_key_version: "encryptionkey@0"
I20260808 16:01:16.242466 24339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/wal/instance:
uuid: "fafd453adb554f5b88bf3cd358a3372d"
format_stamp: "Formatted at 2026-08-08 16:01:16 on dist-test-slave-lgr5"
server_key: "e0404c0a61660810ef87eb06ae6406a6"
server_key_iv: "9c1fcb84bb3aa0f44e0997088dec2a67"
server_key_version: "encryptionkey@0"
I20260808 16:01:16.245827 24339 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 16:01:16.247938 24361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:01:16.249121 24339 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 16:01:16.249233 24339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/wal
uuid: "fafd453adb554f5b88bf3cd358a3372d"
format_stamp: "Formatted at 2026-08-08 16:01:16 on dist-test-slave-lgr5"
server_key: "e0404c0a61660810ef87eb06ae6406a6"
server_key_iv: "9c1fcb84bb3aa0f44e0997088dec2a67"
server_key_version: "encryptionkey@0"
I20260808 16:01:16.249320 24339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:01:16.274519 24339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:01:16.277062 24339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:01:16.277227 24339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:01:16.283819 24339 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.61:41159
I20260808 16:01:16.284157 24441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.61:41159 every 8 connection(s)
I20260808 16:01:16.284756 24339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/data/info.pb
I20260808 16:01:16.287457 24442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:01:16.291230 24442 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } has no permanent_uuid. Determining permanent_uuid...
I20260808 16:01:16.291874 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 24339
I20260808 16:01:16.291975 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-1/wal/instance
I20260808 16:01:16.292281 19828 external_mini_cluster.cc:1428] Setting key ca6a66204b4c223ac5adc12c844e2c8c
WARNING: no policy specified for kudu/127.19.93.60@KRBTEST.COM; defaulting to no policy
Aug 08 16:01:16 dist-test-slave-lgr5 krb5kdc[24201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204876, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.61@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.93.60@KRBTEST.COM" created.
I20260808 16:01:16.304834 24332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.293125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58168 (local address 127.19.93.62:39619)
0808 16:01:16.293283 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.293288 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.294078 (+ 790us) server_negotiation.cc:407] Connection header received
0808 16:01:16.295072 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.295076 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.295139 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.295241 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.296417 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.297232 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.298381 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.298724 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.298837 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.301345 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:16.301351 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:16.301354 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:16.301387 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:16.302656 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.303187 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.303190 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.303193 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.303283 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.303620 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.303624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.303626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.303881 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:16.303996 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:16.304491 (+ 495us) server_negotiation.cc:299] Negotiation successful
0808 16:01:16.304641 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 16:01:16.305675 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.293450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:39619 (local address 127.0.0.1:58168)
0808 16:01:16.293917 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.293972 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:16.294852 (+ 880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:16.295404 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:16.295410 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:16.295745 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:16.296254 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.296271 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.297393 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.297396 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.298240 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.298251 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.298883 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.298887 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.299029 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.299634 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:16.299652 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:16.301168 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:16.302772 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.302777 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.302787 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.303075 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.303389 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.303392 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.303393 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.303521 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.303978 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:16.303982 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:16.304244 (+ 262us) client_negotiation.cc:769] Sending connection context
0808 16:01:16.304396 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 16:01:16.304698 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":115,"threads_started":1}
I20260808 16:01:16.306965 24442 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } has no permanent_uuid. Determining permanent_uuid...
I20260808 16:01:16.309567 24326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } attempt: 3
Aug 08 16:01:16 dist-test-slave-lgr5 krb5kdc[24201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204876, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.61@KRBTEST.COM for kudu/127.19.93.61@KRBTEST.COM
Aug 08 16:01:16 dist-test-slave-lgr5 krb5kdc[24201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204876, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for kudu/127.19.93.61@KRBTEST.COM
I20260808 16:01:16.317631 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.307453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:41159 (local address 127.0.0.1:60204)
0808 16:01:16.307614 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.307628 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:16.307697 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:16.308098 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:16.308102 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:16.308261 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:16.308366 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.308374 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.309269 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.309273 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.310392 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.310403 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.311068 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.311071 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.311158 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.311555 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:16.311566 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:16.313596 (+ 2030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:16.315543 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.315546 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.315548 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.315743 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.316545 (+ 802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.316549 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.316551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.316631 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.317094 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:16.317097 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:16.317170 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 16:01:16.317253 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 16:01:16.317425 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98}
I20260808 16:01:16.317658 24448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.307522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60204 (local address 127.19.93.61:41159)
0808 16:01:16.307761 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.307770 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.307787 (+ 17us) server_negotiation.cc:407] Connection header received
0808 16:01:16.307820 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.307824 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.307958 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.308062 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.308463 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.309159 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.310486 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.310968 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.311064 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.313710 (+ 2646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:16.313721 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:16.313733 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:16.313758 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:16.315467 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.315841 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.315847 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.315848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.316454 (+ 606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.316707 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.316711 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.316712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.316999 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:16.317127 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:16.317350 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 16:01:16.317483 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":74,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.93.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.60.keytab.
Entry for principal kudu/127.19.93.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.60.keytab.
I20260808 16:01:16.319213 24335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.309918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:41159 (local address 127.0.0.1:60214)
0808 16:01:16.310038 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.310053 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:16.310127 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:16.310429 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:16.310432 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:16.310616 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:16.310706 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.310712 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.311637 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.311640 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.312710 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.312720 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.313331 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.313335 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.313484 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.313917 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:16.313928 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:16.315353 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:16.317479 (+ 2126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.317482 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.317484 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.317694 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.318149 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.318152 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.318154 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.318231 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.318651 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:16.318654 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:16.318785 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 16:01:16.318878 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 16:01:16.319063 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 16:01:16.319361 24442 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } has no permanent_uuid. Determining permanent_uuid...
I20260808 16:01:16.319779 19828 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
/tmp/dist-test-taskeiRfxd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.60:33157
--webserver_interface=127.19.93.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.60.keytab
--principal=kudu/127.19.93.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.93.20:39081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.93.62:39619,127.19.93.61:41159,127.19.93.60:33157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 16:01:16.319984 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.319753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:33157 (local address 127.0.0.1:38022)
0808 16:01:16.319849 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.319920 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 16:01:16.320175 24365 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
I20260808 16:01:16.320919 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.320724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:33157 (local address 127.0.0.1:38032)
0808 16:01:16.320827 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.320870 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 16:01:16.321034 24442 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:33157: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
I20260808 16:01:16.321203 24449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.309998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60214 (local address 127.19.93.61:41159)
0808 16:01:16.310247 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.310253 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.310263 (+ 10us) server_negotiation.cc:407] Connection header received
0808 16:01:16.310289 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.310291 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.310321 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.310395 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.310828 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.311533 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.312871 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.313221 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.313312 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.315481 (+ 2169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:16.315484 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:16.315486 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:16.315507 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:16.317368 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.317974 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.317977 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.317979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.318060 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.318391 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.318395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.318397 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.318563 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:16.318646 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:16.318943 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 16:01:16.319047 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":198,"thread_start_us":109,"threads_started":1}
I20260808 16:01:16.321775 24326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } has no permanent_uuid. Determining permanent_uuid...
I20260808 16:01:16.322407 24335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.322177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:33157 (local address 127.0.0.1:38034)
0808 16:01:16.322280 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.322327 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 16:01:16.323063 24335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.322848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:33157 (local address 127.0.0.1:38048)
0808 16:01:16.322973 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.323017 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 16:01:16.323164 24326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:33157: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
I20260808 16:01:16.354301 24326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } attempt: 1
I20260808 16:01:16.355108 24335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.354814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:33157 (local address 127.0.0.1:38054)
0808 16:01:16.354956 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.355015 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 16:01:16.355774 24335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.355567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:33157 (local address 127.0.0.1:38068)
0808 16:01:16.355668 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.355714 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 16:01:16.355901 24326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:33157: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
I20260808 16:01:16.370281 24442 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } attempt: 1
I20260808 16:01:16.371028 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.370763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:33157 (local address 127.0.0.1:38076)
0808 16:01:16.370901 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.370956 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 16:01:16.371681 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.371498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:33157 (local address 127.0.0.1:38082)
0808 16:01:16.371586 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.371627 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 16:01:16.371816 24442 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:33157: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
W20260808 16:01:16.429415 24453 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 16:01:16.429654 24453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 16:01:16.429705 24453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 16:01:16.429752 24453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 16:01:16.431038 24326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } attempt: 2
I20260808 16:01:16.431756 24335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.431486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:33157 (local address 127.0.0.1:38090)
0808 16:01:16.431623 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.431682 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 16:01:16.432467 24335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.432275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:33157 (local address 127.0.0.1:38100)
0808 16:01:16.432363 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.432412 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 16:01:16.432586 24326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:33157: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
W20260808 16:01:16.433955 24453 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 16:01:16.434005 24453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 16:01:16.434024 24453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 16:01:16.434060 24453 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 16:01:16.434087 24453 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 16:01:16.439079 24453 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.93.20:39081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.93.62:39619,127.19.93.61:41159,127.19.93.60:33157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/krb5kdc/kudu_127.19.93.60.keytab
--principal=kudu/127.19.93.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.93.60:33157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.93.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 16:01:16.439983 24442 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } attempt: 2
I20260808 16:01:16.440052 24453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 16:01:16.440663 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.440418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:33157 (local address 127.0.0.1:38116)
0808 16:01:16.440544 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.440600 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 16:01:16.441049 24453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 16:01:16.441356 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.441139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:33157 (local address 127.0.0.1:38124)
0808 16:01:16.441252 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.441299 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 16:01:16.441494 24442 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.93.60:33157: Network error: Client connection negotiation failed: client connection to 127.19.93.60:33157: connect: Connection refused (error 111)
W20260808 16:01:16.448956 24466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:16.448969 24462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 16:01:16.449002 24464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 16:01:16.449340 24453 server_base.cc:1034] running on GCE node
I20260808 16:01:16.449826 24453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 16:01:16.450788 24453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 16:01:16.451949 24453 hybrid_clock.cc:648] HybridClock initialized: now 1786204876451927 us; error 31 us; skew 500 ppm
Aug 08 16:01:16 dist-test-slave-lgr5 krb5kdc[24201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204876, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 16:01:16.458839 24453 init.cc:377] Logged in from keytab as kudu/127.19.93.60@KRBTEST.COM (short username kudu)
I20260808 16:01:16.459653 24453 webserver.cc:460] Webserver started at http://127.19.93.60:37451/ using document root <none> and password file <none>
I20260808 16:01:16.460172 24453 fs_manager.cc:359] Metadata directory not provided
I20260808 16:01:16.460237 24453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 16:01:16.460400 24453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 16:01:16.462268 24453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/data/instance:
uuid: "29679023180147fcabc1d5b5310f2660"
format_stamp: "Formatted at 2026-08-08 16:01:16 on dist-test-slave-lgr5"
server_key: "fcfed9b5cd55ac6986bca2ea9eef6b5e"
server_key_iv: "618a1420840f13ca53ad4beb93dad885"
server_key_version: "encryptionkey@0"
I20260808 16:01:16.462756 24453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/wal/instance:
uuid: "29679023180147fcabc1d5b5310f2660"
format_stamp: "Formatted at 2026-08-08 16:01:16 on dist-test-slave-lgr5"
server_key: "fcfed9b5cd55ac6986bca2ea9eef6b5e"
server_key_iv: "618a1420840f13ca53ad4beb93dad885"
server_key_version: "encryptionkey@0"
I20260808 16:01:16.466151 24453 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 16:01:16.468297 24478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 16:01:16.469393 24453 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 16:01:16.469498 24453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/data,/tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/wal
uuid: "29679023180147fcabc1d5b5310f2660"
format_stamp: "Formatted at 2026-08-08 16:01:16 on dist-test-slave-lgr5"
server_key: "fcfed9b5cd55ac6986bca2ea9eef6b5e"
server_key_iv: "618a1420840f13ca53ad4beb93dad885"
server_key_version: "encryptionkey@0"
I20260808 16:01:16.469615 24453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 16:01:16.489944 24453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 16:01:16.492795 24453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 16:01:16.492978 24453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 16:01:16.499959 24453 rpc_server.cc:307] RPC server started. Bound to: 127.19.93.60:33157
I20260808 16:01:16.500219 24563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.93.60:33157 every 8 connection(s)
I20260808 16:01:16.500982 24453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/data/info.pb
I20260808 16:01:16.503625 24565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 16:01:16.505776 19828 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu as pid 24453
I20260808 16:01:16.505925 19828 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskeiRfxd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786204595622323-19828-0/minicluster-data/master-2/wal/instance
I20260808 16:01:16.506258 19828 external_mini_cluster.cc:1428] Setting key d6d4f39fe77f8643ac9688c0b4c54174
I20260808 16:01:16.507800 24565 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 16:01:16 dist-test-slave-lgr5 krb5kdc[24201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204876, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.60@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
Aug 08 16:01:16 dist-test-slave-lgr5 krb5kdc[24201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.60@KRBTEST.COM
I20260808 16:01:16.518604 24332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.509379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58184 (local address 127.19.93.62:39619)
0808 16:01:16.509504 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.509509 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.509872 (+ 363us) server_negotiation.cc:407] Connection header received
0808 16:01:16.509984 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.509987 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.510042 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.510107 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.510927 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.511416 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.512431 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.512643 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.512731 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.514916 (+ 2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:16.514920 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:16.514922 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:16.514950 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:16.516457 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.516996 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.517000 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.517002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.517090 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.517467 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.517471 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.517472 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.517722 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:16.517799 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:16.518314 (+ 515us) server_negotiation.cc:299] Negotiation successful
0808 16:01:16.518442 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 16:01:16.519481 24569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.509311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.62:39619 (local address 127.0.0.1:58184)
0808 16:01:16.509725 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.509770 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:16.509889 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:16.510169 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:16.510175 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:16.510596 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:16.510786 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.510799 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.511535 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.511538 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.512321 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.512329 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.512774 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.512777 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.512951 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.513427 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:16.513442 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:16.514750 (+ 1308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:16.516563 (+ 1813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.516571 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.516579 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.516906 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.517173 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.517175 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.517176 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.517334 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.517817 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:16.517822 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:16.518108 (+ 286us) client_negotiation.cc:769] Sending connection context
0808 16:01:16.518274 (+ 166us) client_negotiation.cc:240] Negotiation successful
0808 16:01:16.518565 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":61,"spinlock_wait_cycles":29184,"thread_start_us":122,"threads_started":1}
I20260808 16:01:16.519481 24568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.507522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38138 (local address 127.19.93.60:33157)
0808 16:01:16.507911 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.507927 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.507961 (+ 34us) server_negotiation.cc:407] Connection header received
0808 16:01:16.508646 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.508663 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.508989 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.509263 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.510057 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.511297 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.512178 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.512637 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.512773 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.515349 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:16.515356 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:16.515365 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:16.515387 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:16.516835 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.517287 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.517292 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.517294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.517369 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.517673 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.517675 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.517676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.518102 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:16.518290 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:16.518492 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 16:01:16.518603 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":7,"server-negotiator.queue_time_us":251,"thread_start_us":108,"threads_started":1}
I20260808 16:01:16.520655 24565 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 16:01:16 dist-test-slave-lgr5 krb5kdc[24201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204876, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.60@KRBTEST.COM for kudu/127.19.93.61@KRBTEST.COM
Aug 08 16:01:16 dist-test-slave-lgr5 krb5kdc[24201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.62@KRBTEST.COM
I20260808 16:01:16.530746 24569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.521083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.61:41159 (local address 127.0.0.1:60224)
0808 16:01:16.521223 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.521236 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:16.521301 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:16.521553 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:16.521555 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:16.521672 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:16.521756 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.521761 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.522581 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.522584 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.523380 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.523389 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.523958 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.523960 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.524029 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.526762 (+ 2733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:16.526776 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:16.527841 (+ 1065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:16.529452 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.529455 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.529457 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.529634 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.529896 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.529900 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.529901 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.529982 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.530326 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:16.530328 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:16.530407 (+ 79us) client_negotiation.cc:769] Sending connection context
0808 16:01:16.530510 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 16:01:16.530631 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 16:01:16.530963 24449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.521208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60224 (local address 127.19.93.61:41159)
0808 16:01:16.521340 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.521344 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.521364 (+ 20us) server_negotiation.cc:407] Connection header received
0808 16:01:16.521399 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.521401 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.521445 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.521526 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.521876 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.522475 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.523488 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.523862 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.523963 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.527982 (+ 4019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:16.527985 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:16.527988 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:16.528017 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:16.529326 (+ 1309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.529720 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.529723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.529725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.529803 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.530065 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.530067 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.530069 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.530230 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:16.530326 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:16.530568 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 16:01:16.530686 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 16:01:16.531493 24332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.521835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58190 (local address 127.19.93.62:39619)
0808 16:01:16.521964 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.521968 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.521979 (+ 11us) server_negotiation.cc:407] Connection header received
0808 16:01:16.522009 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.522011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.522049 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.522118 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.522622 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.523351 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.524323 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.524519 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.524601 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.528535 (+ 3934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:16.528544 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:16.528546 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:16.528567 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:16.529891 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.530282 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.530285 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.530287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.530367 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.530621 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.530623 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.530625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.530826 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:16.531059 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:16.531266 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 16:01:16.531359 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 16:01:16.531589 24565 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } has no permanent_uuid. Determining permanent_uuid...
I20260808 16:01:16.531728 24326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } attempt: 3
I20260808 16:01:16.532635 24442 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } attempt: 3
Aug 08 16:01:16 dist-test-slave-lgr5 krb5kdc[24201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204876, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.60@KRBTEST.COM for kudu/127.19.93.60@KRBTEST.COM
Aug 08 16:01:16 dist-test-slave-lgr5 krb5kdc[24201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204876, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.62@KRBTEST.COM for kudu/127.19.93.60@KRBTEST.COM
Aug 08 16:01:16 dist-test-slave-lgr5 krb5kdc[24201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204876, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.93.61@KRBTEST.COM for kudu/127.19.93.60@KRBTEST.COM
Aug 08 16:01:16 dist-test-slave-lgr5 krb5kdc[24201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.93.61@KRBTEST.COM
I20260808 16:01:16.541947 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.532928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:33157 (local address 127.0.0.1:38160)
0808 16:01:16.533142 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.533155 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:16.533218 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:16.533981 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:16.533985 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:16.534152 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:16.534252 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.534258 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.535315 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.535318 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.536161 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.536173 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.536711 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.536714 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.536800 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.537248 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:16.537260 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:16.538432 (+ 1172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:16.540448 (+ 2016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.540451 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.540453 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.540687 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.540990 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.540993 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.540995 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.541078 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.541499 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:16.541502 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:16.541588 (+ 86us) client_negotiation.cc:769] Sending connection context
0808 16:01:16.541673 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 16:01:16.541788 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":17,"spinlock_wait_cycles":2432}
I20260808 16:01:16.541944 24335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.532006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:33157 (local address 127.0.0.1:38158)
0808 16:01:16.532170 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.532182 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:16.532251 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:16.533145 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:16.533148 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:16.533308 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:16.533390 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.533397 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.534906 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.534909 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.535657 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.535666 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.536121 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.536124 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.536201 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.536606 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:16.536621 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:16.538432 (+ 1811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:16.540570 (+ 2138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.540573 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.540575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.540793 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.541077 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.541080 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.541082 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.541165 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.541516 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:16.541519 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:16.541595 (+ 76us) client_negotiation.cc:769] Sending connection context
0808 16:01:16.541673 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 16:01:16.541788 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101}
I20260808 16:01:16.542454 24570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.532187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38158 (local address 127.19.93.60:33157)
0808 16:01:16.532932 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.532943 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.532954 (+ 11us) server_negotiation.cc:407] Connection header received
0808 16:01:16.532982 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.532984 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.533020 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.533489 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.533578 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.534776 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.535769 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.536002 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.536118 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.538586 (+ 2468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:16.538589 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:16.538592 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:16.538616 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:16.540461 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.540908 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.540911 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.540913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.540982 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.541264 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.541267 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.541269 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.541417 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:16.542106 (+ 689us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:16.542184 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 16:01:16.542291 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":202,"server-negotiator.queue_time_us":682,"thread_start_us":100,"threads_started":1}
I20260808 16:01:16.542613 24571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.533341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38160 (local address 127.19.93.60:33157)
0808 16:01:16.533743 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.533750 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.533762 (+ 12us) server_negotiation.cc:407] Connection header received
0808 16:01:16.533793 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.533796 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.533835 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.534368 (+ 533us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.534475 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.535199 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.536271 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.536577 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.536999 (+ 422us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.538620 (+ 1621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:16.538624 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:16.538626 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:16.538659 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:16.540314 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.540805 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.540808 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.540810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.540890 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.541182 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.541185 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.541187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.541386 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:16.542283 (+ 897us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:16.542348 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 16:01:16.542455 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":109,"threads_started":1}
I20260808 16:01:16.543109 24569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.531958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.93.60:33157 (local address 127.0.0.1:38150)
0808 16:01:16.532277 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 16:01:16.532289 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 16:01:16.532354 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 16:01:16.532614 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 16:01:16.532616 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 16:01:16.532763 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0808 16:01:16.532843 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.532849 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.533771 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.533774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.534551 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 16:01:16.534560 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.535199 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.535202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 16:01:16.535272 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.535673 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 16:01:16.535687 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 16:01:16.538892 (+ 3205us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 16:01:16.541728 (+ 2836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.541731 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.541733 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.541944 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.542207 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 16:01:16.542209 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 16:01:16.542211 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 16:01:16.542275 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 16:01:16.542664 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 16:01:16.542666 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 16:01:16.542735 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 16:01:16.542832 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 16:01:16.542943 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265}
I20260808 16:01:16.543155 24568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.532174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38150 (local address 127.19.93.60:33157)
0808 16:01:16.532277 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.532281 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.532325 (+ 44us) server_negotiation.cc:407] Connection header received
0808 16:01:16.532433 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.532436 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.532471 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.532527 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.532947 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.533672 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.534654 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.534993 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.535107 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.539998 (+ 4891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:16.540002 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:16.540005 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:16.540030 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:16.541623 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.542036 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.542052 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.542054 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.542134 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.542348 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.542351 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.542353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.542546 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:16.542634 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:16.542902 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 16:01:16.543006 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":39}
I20260808 16:01:16.545506 24326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4: Bootstrap starting.
I20260808 16:01:16.545639 24565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660: Bootstrap starting.
I20260808 16:01:16.545639 24442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d: Bootstrap starting.
I20260808 16:01:16.547678 24326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4: Neither blocks nor log segments found. Creating new log.
I20260808 16:01:16.547976 24442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d: Neither blocks nor log segments found. Creating new log.
I20260808 16:01:16.547976 24565 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660: Neither blocks nor log segments found. Creating new log.
I20260808 16:01:16.548405 24449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.532752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60230 (local address 127.19.93.61:41159)
0808 16:01:16.532896 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.532899 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.532911 (+ 12us) server_negotiation.cc:407] Connection header received
0808 16:01:16.532944 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.532946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.532982 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.533739 (+ 757us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.533820 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.534522 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.535558 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.536591 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.537001 (+ 410us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.539031 (+ 2030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:16.539035 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:16.539037 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:16.539062 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:16.540531 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.541027 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.541030 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.541031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.541118 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.541436 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.541439 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.541441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.541649 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:16.543122 (+ 1473us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:16.543497 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 16:01:16.543617 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":80}
I20260808 16:01:16.548481 24326 log.cc:824] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4: Log is configured to *not* fsync() on all Append() calls
I20260808 16:01:16.548784 24565 log.cc:824] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660: Log is configured to *not* fsync() on all Append() calls
I20260808 16:01:16.549069 24442 log.cc:824] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d: Log is configured to *not* fsync() on all Append() calls
I20260808 16:01:16.550923 24326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4: No bootstrap required, opened a new log
I20260808 16:01:16.551110 24565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660: No bootstrap required, opened a new log
I20260808 16:01:16.551110 24442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d: No bootstrap required, opened a new log
I20260808 16:01:16.551749 19828 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 16:01:16.553012 24289 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "6af5a60c68e1425a9823af3108871fe4"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58190
I20260808 16:01:16.555189 24442 raft_consensus.cc:348] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } }
I20260808 16:01:16.555410 24442 raft_consensus.cc:729] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fafd453adb554f5b88bf3cd358a3372d, State: Initialized, Role: FOLLOWER
I20260808 16:01:16.555321 24326 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } }
I20260808 16:01:16.555523 24326 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6af5a60c68e1425a9823af3108871fe4, State: Initialized, Role: FOLLOWER
I20260808 16:01:16.555507 24565 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } }
I20260808 16:01:16.555723 24565 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29679023180147fcabc1d5b5310f2660, State: Initialized, Role: FOLLOWER
I20260808 16:01:16.555732 24442 consensus_queue.cc:260] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } }
I20260808 16:01:16.555819 24326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } }
I20260808 16:01:16.555994 24565 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } }
I20260808 16:01:16.556636 24582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } } }
I20260808 16:01:16.556926 24582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 16:01:16.557214 24326 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:01:16.557214 24565 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:01:16.557214 24442 sys_catalog.cc:564] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 16:01:16.557286 24289 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 16:01:16.557402 24289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:01:16.558642 24289 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } }
I20260808 16:01:16.559571 24289 leader_election.cc:288] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [CANDIDATE]: Term 1 election: Requested vote from peers fafd453adb554f5b88bf3cd358a3372d (127.19.93.61:41159), 29679023180147fcabc1d5b5310f2660 (127.19.93.60:33157)
I20260808 16:01:16.560645 24403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6af5a60c68e1425a9823af3108871fe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "fafd453adb554f5b88bf3cd358a3372d"
I20260808 16:01:16.560837 24403 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:01:16.562052 24403 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6af5a60c68e1425a9823af3108871fe4 in term 1.
W20260808 16:01:16.562443 24627 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 16:01:16.562526 24627 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 16:01:16.562443 24516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6af5a60c68e1425a9823af3108871fe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "29679023180147fcabc1d5b5310f2660"
I20260808 16:01:16.562646 24516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660 [term 0 FOLLOWER]: Advancing to term 1
I20260808 16:01:16.562793 24577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } } }
I20260808 16:01:16.562907 24577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 16:01:16.563009 24576 sys_catalog.cc:455] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } } }
I20260808 16:01:16.563123 24576 sys_catalog.cc:458] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 16:01:16.563213 24240 leader_election.cc:302] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6af5a60c68e1425a9823af3108871fe4, fafd453adb554f5b88bf3cd358a3372d; no voters:
W20260808 16:01:16.562444 24630 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 16:01:16.563725 24630 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 16:01:16.563843 24516 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6af5a60c68e1425a9823af3108871fe4 in term 1.
I20260808 16:01:16.564358 24577 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 16:01:16.564621 24577 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [term 1 LEADER]: Becoming Leader. State: Replica: 6af5a60c68e1425a9823af3108871fe4, State: Running, Role: LEADER
I20260808 16:01:16.564932 24577 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } }
W20260808 16:01:16.567427 24245 tablet.cc:2369] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 16:01:16.571774 24339 master_runner.cc:263] No leader master found from master fafd453adb554f5b88bf3cd358a3372d
I20260808 16:01:16.571843 24339 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 16:01:16.573523 24221 master_runner.cc:263] No leader master found from master 6af5a60c68e1425a9823af3108871fe4
I20260808 16:01:16.573582 24221 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 16:01:16.574541 24453 master_runner.cc:263] No leader master found from master 29679023180147fcabc1d5b5310f2660
I20260808 16:01:16.574599 24453 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 16:01:16.574683 24638 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 16:01:16.574751 24638 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 16:01:16.576476 24449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.567308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60238 (local address 127.19.93.61:41159)
0808 16:01:16.567414 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.567419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.567872 (+ 453us) server_negotiation.cc:407] Connection header received
0808 16:01:16.567969 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.567972 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.568013 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.568110 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.569001 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.569747 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.570888 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.571181 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.571252 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.573000 (+ 1748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:16.573004 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:16.573006 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:16.573032 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:16.574589 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.575083 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.575087 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.575089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.575174 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.575489 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.575493 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.575495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.575710 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:16.575822 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:16.576209 (+ 387us) server_negotiation.cc:299] Negotiation successful
0808 16:01:16.576325 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 16:01:16.576965 24640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6af5a60c68e1425a9823af3108871fe4. Latest consensus state: current_term: 1 leader_uuid: "6af5a60c68e1425a9823af3108871fe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } } }
I20260808 16:01:16.577078 24640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:16.577804 24651 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 16:01:16.578771 24651 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 16:01:16.581197 24571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.568386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38164 (local address 127.19.93.60:33157)
0808 16:01:16.568491 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.568496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.568830 (+ 334us) server_negotiation.cc:407] Connection header received
0808 16:01:16.569002 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.569005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.569057 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.569104 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.570028 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.570783 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.572095 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.572462 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.572542 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.575832 (+ 3290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:16.575835 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:16.575838 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:16.575863 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:16.577970 (+ 2107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.579597 (+ 1627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.579601 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.579602 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.579689 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.580266 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.580269 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.580271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.580477 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:16.580577 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:16.580938 (+ 361us) server_negotiation.cc:299] Negotiation successful
0808 16:01:16.581061 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 16:01:16.582552 24332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:16.572298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58200 (local address 127.19.93.62:39619)
0808 16:01:16.572418 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.572422 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.572435 (+ 13us) server_negotiation.cc:407] Connection header received
0808 16:01:16.572467 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.572469 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.572506 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.572578 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.574131 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.574816 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.575898 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:16.576246 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:16.576321 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:16.579016 (+ 2695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 16:01:16.579020 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 16:01:16.579023 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 16:01:16.579049 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 16:01:16.580657 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.581136 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.581140 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.581142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.581226 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 16:01:16.581627 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 16:01:16.581631 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 16:01:16.581633 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 16:01:16.581838 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 16:01:16.581938 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:16.582282 (+ 344us) server_negotiation.cc:299] Negotiation successful
0808 16:01:16.582410 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 16:01:16.584437 24403 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d [term 1 FOLLOWER]: Refusing update from remote peer 6af5a60c68e1425a9823af3108871fe4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 16:01:16.585124 24577 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 16:01:16.585855 24516 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660 [term 1 FOLLOWER]: Refusing update from remote peer 6af5a60c68e1425a9823af3108871fe4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 16:01:16.586381 24577 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 16:01:16.593407 24576 sys_catalog.cc:455] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6af5a60c68e1425a9823af3108871fe4. Latest consensus state: current_term: 1 leader_uuid: "6af5a60c68e1425a9823af3108871fe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } } }
I20260808 16:01:16.593521 24576 sys_catalog.cc:458] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 16:01:16.593878 24582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6af5a60c68e1425a9823af3108871fe4. Latest consensus state: current_term: 1 leader_uuid: "6af5a60c68e1425a9823af3108871fe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } } }
I20260808 16:01:16.594009 24582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 16:01:16.601953 24652 mvcc.cc:205] Tried to move back new op lower bound from 7316295174481416192 to 7316295174412840960. Current Snapshot: MvccSnapshot[applied={T|T < 7316295174481416192}]
I20260808 16:01:16.602492 24577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6af5a60c68e1425a9823af3108871fe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } } }
I20260808 16:01:16.602599 24577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:16.603475 24577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6af5a60c68e1425a9823af3108871fe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } } }
I20260808 16:01:16.603578 24577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4 [sys.catalog]: This master's current role is: LEADER
I20260808 16:01:16.603672 24576 sys_catalog.cc:455] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6af5a60c68e1425a9823af3108871fe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } } }
I20260808 16:01:16.603762 24576 sys_catalog.cc:458] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 16:01:16.605145 24582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6af5a60c68e1425a9823af3108871fe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af5a60c68e1425a9823af3108871fe4" member_type: VOTER last_known_addr { host: "127.19.93.62" port: 39619 } } peers { permanent_uuid: "fafd453adb554f5b88bf3cd358a3372d" member_type: VOTER last_known_addr { host: "127.19.93.61" port: 41159 } } peers { permanent_uuid: "29679023180147fcabc1d5b5310f2660" member_type: VOTER last_known_addr { host: "127.19.93.60" port: 33157 } } }
I20260808 16:01:16.605252 24582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 16:01:16.605739 24657 mvcc.cc:205] Tried to move back new op lower bound from 7316295174481416192 to 7316295174412840960. Current Snapshot: MvccSnapshot[applied={T|T < 7316295174481416192}]
I20260808 16:01:16.605911 24654 mvcc.cc:205] Tried to move back new op lower bound from 7316295174481416192 to 7316295174412840960. Current Snapshot: MvccSnapshot[applied={T|T < 7316295174481416192}]
I20260808 16:01:16.609045 24651 catalog_manager.cc:1347] Generated new cluster ID: 08480c6185da4c99b9bb431a85baa41e
I20260808 16:01:16.609107 24651 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 16:01:16.634418 24651 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 16:01:16.635599 24651 catalog_manager.cc:1504] Loading token signing keys...
I20260808 16:01:16.647603 24651 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6af5a60c68e1425a9823af3108871fe4: Generated new TSK 0
I20260808 16:01:16.648343 24651 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 16:01:16.678363 24571 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:16.675431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38178 (local address 127.19.93.60:33157)
0808 16:01:16.675557 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.675562 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.677339 (+ 1777us) server_negotiation.cc:407] Connection header received
0808 16:01:16.677541 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.677545 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.677591 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.677643 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.678220 (+ 577us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38178: BlockingRecv error: recv got EOF from 127.0.0.1:38178 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 16:01:16.679654 24332 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:16.676049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58202 (local address 127.19.93.62:39619)
0808 16:01:16.676168 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.676172 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.678806 (+ 2634us) server_negotiation.cc:407] Connection header received
0808 16:01:16.678968 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.678971 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.679016 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.679062 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.679537 (+ 475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58202: BlockingRecv error: recv got EOF from 127.0.0.1:58202 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 16:01:16.680945 24449 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:16.676733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60242 (local address 127.19.93.61:41159)
0808 16:01:16.676838 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.676842 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.680067 (+ 3225us) server_negotiation.cc:407] Connection header received
0808 16:01:16.680259 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.680262 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.680305 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.680349 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.680831 (+ 482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60242: BlockingRecv error: recv got EOF from 127.0.0.1:60242 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260808 16:01:16.684976 24449 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:16.683487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60250 (local address 127.19.93.61:41159)
0808 16:01:16.683576 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.683580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.684031 (+ 451us) server_negotiation.cc:407] Connection header received
0808 16:01:16.684278 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.684281 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.684363 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.684413 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.684884 (+ 471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60250: BlockingRecv error: recv got EOF from 127.0.0.1:60250 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260808 16:01:16.692070 24449 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:16.690679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60256 (local address 127.19.93.61:41159)
0808 16:01:16.690773 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.690777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.691261 (+ 484us) server_negotiation.cc:407] Connection header received
0808 16:01:16.691447 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.691450 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.691496 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.691542 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.691981 (+ 439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60256: BlockingRecv error: recv got EOF from 127.0.0.1:60256 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 16:01:16.707280 24449 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:16.705738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60272 (local address 127.19.93.61:41159)
0808 16:01:16.705839 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.705843 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.706371 (+ 528us) server_negotiation.cc:407] Connection header received
0808 16:01:16.706579 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.706582 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.706632 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.706680 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.707181 (+ 501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60272: BlockingRecv error: recv got EOF from 127.0.0.1:60272 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260808 16:01:16.722013 24449 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:16.720490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60288 (local address 127.19.93.61:41159)
0808 16:01:16.720651 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.720655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.721234 (+ 579us) server_negotiation.cc:407] Connection header received
0808 16:01:16.721357 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.721361 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.721417 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.721494 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.721895 (+ 401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60288: BlockingRecv error: recv got EOF from 127.0.0.1:60288 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260808 16:01:16.737330 24449 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:16.732584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60298 (local address 127.19.93.61:41159)
0808 16:01:16.732728 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.732733 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.736355 (+ 3622us) server_negotiation.cc:407] Connection header received
0808 16:01:16.736570 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.736574 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.736627 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.736678 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.737220 (+ 542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60298: BlockingRecv error: recv got EOF from 127.0.0.1:60298 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260808 16:01:16.765214 24449 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:16.763420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60314 (local address 127.19.93.61:41159)
0808 16:01:16.763545 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.763550 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.764159 (+ 609us) server_negotiation.cc:407] Connection header received
0808 16:01:16.764405 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.764408 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.764470 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.764529 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.765096 (+ 567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60314: BlockingRecv error: recv got EOF from 127.0.0.1:60314 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 16:01:16.800729 24449 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:16.799571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60316 (local address 127.19.93.61:41159)
0808 16:01:16.799721 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.799725 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.799842 (+ 117us) server_negotiation.cc:407] Connection header received
0808 16:01:16.799989 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.799992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.800040 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.800136 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.800610 (+ 474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60316: BlockingRecv error: recv got EOF from 127.0.0.1:60316 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260808 16:01:16.867812 24449 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:16.866725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60320 (local address 127.19.93.61:41159)
0808 16:01:16.866869 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.866873 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.867033 (+ 160us) server_negotiation.cc:407] Connection header received
0808 16:01:16.867164 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.867166 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.867215 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.867284 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.867689 (+ 405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60320: BlockingRecv error: recv got EOF from 127.0.0.1:60320 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260808 16:01:16.999177 24449 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:16.998008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60326 (local address 127.19.93.61:41159)
0808 16:01:16.998181 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:16.998186 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:16.998296 (+ 110us) server_negotiation.cc:407] Connection header received
0808 16:01:16.998457 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:16.998460 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:16.998512 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:16.998587 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:16.999072 (+ 485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60326: BlockingRecv error: recv got EOF from 127.0.0.1:60326 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260808 16:01:17.258919 24449 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 16:01:17.257616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60342 (local address 127.19.93.61:41159)
0808 16:01:17.257784 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:17.257789 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:17.257884 (+ 95us) server_negotiation.cc:407] Connection header received
0808 16:01:17.258134 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:17.258138 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:17.258190 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:17.258276 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 16:01:17.258796 (+ 520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60342: BlockingRecv error: recv got EOF from 127.0.0.1:60342 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 16:01:17.565056 24630 catalog_manager.cc:1259] Loaded cluster ID: 08480c6185da4c99b9bb431a85baa41e
I20260808 16:01:17.565145 24630 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660: loading cluster ID for follower catalog manager: success
I20260808 16:01:17.566844 24630 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660: acquiring CA information for follower catalog manager: success
I20260808 16:01:17.568001 24630 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 29679023180147fcabc1d5b5310f2660: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 16:01:17.575749 24638 catalog_manager.cc:1259] Loaded cluster ID: 08480c6185da4c99b9bb431a85baa41e
I20260808 16:01:17.575807 24638 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d: loading cluster ID for follower catalog manager: success
I20260808 16:01:17.577306 24638 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d: acquiring CA information for follower catalog manager: success
I20260808 16:01:17.578305 24638 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fafd453adb554f5b88bf3cd358a3372d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 16:01:17.776659 24774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:17.772993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60352 (local address 127.19.93.61:41159)
0808 16:01:17.773264 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:17.773269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:17.773316 (+ 47us) server_negotiation.cc:407] Connection header received
0808 16:01:17.773460 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:17.773462 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:17.773595 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:17.773691 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 16:01:17.773916 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:17.774502 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:17.775298 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:17.775541 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:17.775615 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:17.775851 (+ 236us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 16:01:17.776312 (+ 461us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 16:01:17.776452 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:17.776481 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 16:01:17.776535 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":89,"threads_started":1}
I20260808 16:01:17.782859 24783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:17.779456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38188 (local address 127.19.93.60:33157)
0808 16:01:17.779689 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:17.779693 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:17.779707 (+ 14us) server_negotiation.cc:407] Connection header received
0808 16:01:17.779799 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:17.779802 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:17.779909 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:17.780009 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 16:01:17.780256 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:17.780755 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:17.781546 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:17.781769 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:17.781858 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:17.782134 (+ 276us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 16:01:17.782481 (+ 347us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 16:01:17.782579 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:17.782673 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 16:01:17.782724 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":61,"threads_started":1}
I20260808 16:01:17.788990 24774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:17.785666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60368 (local address 127.19.93.61:41159)
0808 16:01:17.785780 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:17.785784 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:17.785889 (+ 105us) server_negotiation.cc:407] Connection header received
0808 16:01:17.786009 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:17.786012 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:17.786057 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:17.786117 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 16:01:17.786362 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:17.787117 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:17.787972 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:17.788288 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:17.788379 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:17.788595 (+ 216us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 16:01:17.788661 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 16:01:17.788718 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:17.788813 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 16:01:17.788864 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 16:01:17.789769 24783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:17.785662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38190 (local address 127.19.93.60:33157)
0808 16:01:17.785770 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:17.785774 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:17.786014 (+ 240us) server_negotiation.cc:407] Connection header received
0808 16:01:17.786113 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:17.786116 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:17.786159 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:17.786232 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 16:01:17.786480 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:17.787202 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:17.788438 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:17.788779 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:17.788851 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:17.789288 (+ 437us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 16:01:17.789365 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 16:01:17.789421 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:17.789608 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 16:01:17.789660 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 16:01:17.790256 24793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 16:01:17.785391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58206 (local address 127.19.93.62:39619)
0808 16:01:17.785929 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0808 16:01:17.785933 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 16:01:17.785948 (+ 15us) server_negotiation.cc:407] Connection header received
0808 16:01:17.786036 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 16:01:17.786049 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 16:01:17.786188 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 16:01:17.786287 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 16:01:17.786581 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:17.787098 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:17.788432 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 16:01:17.788790 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 16:01:17.788875 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 16:01:17.789411 (+ 536us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 16:01:17.789818 (+ 407us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 16:01:17.789898 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 16:01:17.790053 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 16:01:17.790118 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":71,"threads_started":1}
I20260808 16:01:17.793020 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 24221
I20260808 16:01:17.804184 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 24339
I20260808 16:01:17.816817 19828 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskeiRfxd/build/debug/bin/kudu with pid 24453
2026-08-08T16:01:17Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3170 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6314 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (282194 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST